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CHAPTER  ONE 
INTRODUCTION 


The  rapid  development  of  image  processing  by  digital 

computers  in  the  past  decade  provides  increased  emphasis  on 

the  definition  of  machine  architectures  3  programming 

languages  which  improve  the  digital  com^  ■'rs'  performance 

in  this  area.  Several  workshops  have  be  convened  on  these 

topics  and  the  proceedings  of  the  1980  l  981  workshops 

are  reported  in  Duff  and  Levialdi  (1981) .  In  the  preface  to 

this  report  Duff  and  Levialdi  summarize  three  different 

approaches  taken  to  develop  an  image  processing  language, 

to  program  in  a  high-level  language  (such  as, 
for  example  Fortran)  and  to  call  from  an  image 
processing  library  subroutines  optimally  designed 
for  a  given  machine;  or  to  use  an  interpreter 
like  APL  or  PICASSO  in  which  interactively  and 
accurate  diagnostics  may  be  obtained;  or  finally, 
to  define  a  high-level  language  having  specific 
control  structures  for  local  computations  and 
global  parallelism,  as  will  as  data  structures  and 
data  types  particularly  useful  in  this  field. 

(Duff  and  Levialdi,  1981  p.  vii) 

The  approach  taken  in  this  thesis  to  develop  an  image 
processing  language  is  distinct  from  these  three  approaches. 
Instead  the  Image  Processing  Language  (IPL)  described  in 
this  thesis  is  developed  from  an  examination  of  the  domains 
and  operations  which  are  commonly  used  to  express  image 
processing  algorithms  in  strongly  typed,  high-level 
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languages.  IPL  is  focused  on  abstract  data  types.  The 
exact  structures  used  to  represent  a  data  type  and  the  exact 
implementation  of  the  operations  for  these  types  are  omitted 
whenever  possible.  This  approach  removes  consideration  for 
a  particular  architecture  and  emphasizes  the  fundamental 
characteristics  of  these  domains  and  operations. 

Goals 

The  motivation  behind  this  approach  is  to  develop  a 
readable  and  portable  language.  In  order  for  the  language 
to  be  readable  it  must  be  capable  of  expressing  image 
processing  algorithms  in  a  manner  which  models  their  use  to 
perform  image  processing  rather  than  their  development  or 
implementation.  To  be  portable  the  language  must  separate 
the  expression  of  algorithms  from  their  implementation. 

Four  immediate  goals  which  support  the  developmant  of  a 

readable  and  portable  language  are  to 

develop  a  language  which  contains  a  basic  set  of 
operations  required  to  express  common  image 
processing  operations; 

describe  an  implementation  of  the  language  in  an 
existing,  portable  language; 

demonstrate  the  language's  capabilities  by 
expressing  some  common  image  processing  algorithms 
in  it; 

and  to  provide  for  the  capability  to  implement  the 
language  on  different  machine  architectures. 

Of  course  the  efficiency  of  algorithms  is  of  critical 


importance  to  image  processing  and  an  algorithm's  efficiency 
is  closely  coupled  to  the  architecture  on  which  it  is 


3 

implemented.  Therefore,  a  secondary  objective  of  this 
language  is 

to  define  the  operations  required  in  an 
architecture  designed  for  image  processing. 

By  expressing  algorithms  in  a  manner  which  models  their  use 
rather  than  their  development  or  implementation,  a  different 
insight  into  the  architectural  requirements  inevitably 
results.  Thus  unique  architectural  ideas  may  be  brought  out 
or  the  usefulness  of  previous  ideas  confirmed. 

Previous  Work 

Even  though  the  approach  taken  to  develop  IPL  is 
different  from  previous  approaches,  several  other  languages 
were  studied  to  insure  that  previously  examined  and  useful 
data  structures  or  operations  were  not  omitted.  PIXAL 
(Levialdi  et  al.,  1981),  L  (Radhakr ishnan  et  al.,  1981), 
PICASSO  (Kulpa,  1981),  MAC  (Douglas,  1981),  PPL 
(Gudmundsson ,  1981),  QPE  (Chang,  1981),  AND  PLANG  (Sinha, 
1983)  .  Maggiolo-Schettini  (1981)  provides  a  review  of  these 
languages  and  outlines  five  crucial  features  used  to  measure 
the  expresssive  power  of  a  language  for  image  processing. 
These  features  are: 

(a)  possibility  of  defining  arrays  on  which  to  operate 
in  parallel; 

(b)  possibility  of  selecting  a  subarray  of  an  array  for 
partial  processing; 

(c)  possibility  of  comparison  between  the  neighborhood 
of  an  element  of  an  array  and  a  given  pattern; 


(d)  availability  of  parallel  instructions  with  global 
control; 

(c>  availability  of  parallel  instructions  with  local 
control.  (p.  159) 

All  of  these  features  are  availbale  in  the  implementation  of 
I PL  presented  in  this  thesis.  In  addition,  the  connection 
between  computer  graphics  and  image  processing  languages  was 

examined  to  insure  that  any  capabilities  in  this  similar 

* 

field  were  also  included  (Foley  and  Van  Dam,  1983; 

Williams,  1979).  No  unique  contributions  from  computer 
graphics  languages  were  found,  however. 

The  majority  of  the  languages  for  image  processing 
studied  are  characterized  by  an  emphasis  on  the 
implementation  hardware  available.  In  addition,  they  were 
generally  overlayed  onto  a  high-level  language  such  as 
FORTRAN,  PASCAL,  or  ALGOL,  and  oriented  towards  a  particular 
class  of  digital  picture.  These  characteristics  limited 
these  languages  portability  and  readability. 

Since  a  certain  amount  of  sequential  programming  is 
required  in  any  language  operating  on  currently  available 
processors  the  IPL  includes  sequential  constructs  which  are 
useful  for  writing  readable  and  portable  code.  These 
constructs  are  D-type  control  structures  and  data  type 
definition  capabilities  (both  domain  and  operations  over  the 
domain) .  The  precise  syntax  for  these  capabilities  is  not 
described  here  since  they  have  been  extensively  studied  and 
described  elsewhere,  and  their  precise  syntax  is  not 
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important  at  this  stage  of  the  language  development. 

Ledgard  and  Marcotty  (1981)  provides  the  definition  of  these 
features  for  this  development. 

Since  the  syntax  for  the  D-type  structures  and  data 
typing  are  not  included  here,  an  existing  language  was  used 
to  provide  these  syntax  during  IPL  development.  Ada*  filled 
this  role.  It  was  chosen  because  it  had  recently  been 
accepted  as  an  ANSI  standard  and  the  development  of  the 
language  was  heavily  influenced  by  requirements  for 
readability  and  portability  (Bulman,  1981)  ,  which  are  the 
primary  goals  for  IPL.  The  use  of  Ada  as  a  starting  point 
for  IPL  did  not  restrict  its  development  to  only  those  ideas 
which  could  be  expressed  in  Ada,  however.  The  "For  Each" 
control  structure  described  later  is  the  best  example  of 
this.  In  fact,  the  IPL  description  is  abstracted  from  any 
implementation  and  made  in  an  algebraic  description  of  the 
domains  and  operations  over  them.  It  is  assumed,  however, 
that  Ada's  array  assignment  and  data  type  attribute 
capabilities  are  available.  These  capabilities  are 
described  in  detail  in  an  Ada  language  description  such  as 
Ada  Programming  Language  (1983).  The  ommission  of  these 
features  from  an  IPL  implementation  would  limit  the 
robustness  of  the  language  but  does  not  effect  its 
expressiveness . 


* 


Ada  is  a  trademark  of  the  Department  of  Defense  (Ada  Joint 
Program  Office) . 
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Organization 

This  description  of  IPL  is  organized  into  three  topics: 
a  description  of  IPL  in  mathematical  terms;  an 
implementation  of  IPL  in  Ada  (Ada-IPL) ;  and  examples  of  the 
use  of  Ada-IPL  to  express  some  common  image  processing 
operations.  The  language  description  is  formed  by  defining 
IPL  objects'  domains  in  Chapter  two.  The  operations  over 
these  domains  and  a  control  structure  for  IPL  are  defined  in 
Chapter  three.  The  Ada  implementation  of  IPL  in  Chapter 
four  provides  a  second  description  of  the  language,  a  syntax 
for  demonstrating  its  use,  as  well  as  a  capability  to  use 
IPL  immediately  with  an  Ada  compiler.  Finally,  the  examples 
of  Ada-IPL* s  use  in  Chapter  six  provide  an  evaluation  of 
IPL's  expressiveness  and  provide  a  second  description  of  its 
semantics . 


CHAPTER  TWO 
IPL  OBJECTS 

Five  domains  are  described  in  this  chapter,  picture, 
mask,  region,  boundary,  and  histogram.  Objects  from  these 
domains  are  commonly  used  to  perform  digital  image 
processing . 

Picture 

Informally,  an  image  is  a  two-dimensional  object  whose 
brightness  or  color  may  vary  from  point  to  point  and  is 
usually  modeled  as  a  real  valued  function  of  two  variables 
(Rosenfeld  and  Kak ,  1976).  This  image  is  digitized  by  a 
sampling  process  which  extracts  from  the  image  a  discrete 
set  of  values  ("samples"),  and  then  quantizes  the  samples 
to  yield  values  from  another  discrete  set.  In  IPL,  such 
a  digitized  image  is  called  a  picture.  In  most  practical 
situations,  a  sample  is  the  average  value  of  the  image  over 
some  small  area.  The  areas  used  to  form  the  sample  value 
are  generally  the  area  around  each  member  of  a  discrete, 
usually  regularly  spaced,  set  of  points.  Thus,  a 
digitized  picture  can  be  thought  of  as  a  two  dimensional 
array  of  digitized,  average  values.  The  elements  of  such 
a  picture  ate  called  Pats  (Picture  Atoms)  in  IPL. 
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Pats,  or  Picture  Atoms,  are  referred  to  in  the  current 
literature  as  elements,  pixels,  or  pels.  Although,  as 
described  above,  a  Pat's  value  is  the  digitized,  average 
value  of  the  image  over  some  area,  in  image  processing  the 
Pat  is  generally  assumed  to  contain  the  digitized  value  of 
the  image  at  a  point.  This  may  or  may  not  be  a  good 
assumption  depending  upon  the  sampling  point  set  and  area 
size.  For  IPL  however,  this  assumption  is  used.  The 
primary  impact  of  ths  assumption  will  be  discussed  below, 
where  the  boundary  of  a  region  is  defined.  Thus,  in  IPL, 
the  Pat  is  the  basic  element  of  a  picture  and  is  allowed  to 
have  any  value,  or  vector  of  values,  that  the  user  defines. 
In  addition,  the  user  must  define  the  operations  such  as 
comparison,  addition,  or  any  other  operations  used  in  an 
algorithm  for  the  specified  Pat  domain. 

The  location  of  the  sampling  points  are  also  a  part  of 
the  IPL  picture.  There  are  two  common  methods  of  organizing 
these  sampling  points,  both  of  which  IPL  supports.  The  most 
common  method  uses  a  regularly  spaced,  square  array  of 
points,  i.e.,  points  (m*d,  n*d)  whose  coordinates  are 
multiples  of  some  unit  distance  d.  Such  an  organization  is 
called  orthogonal  in  IPL.  The  other  method  commonly  used  to 
organize  a  picture  uses  a  regular  hexagonal  array  of  sample 
points.  This  array  can  be  obtained  from  a  square  array  by 
shifting  the  odd-numbered  (even)  rows  d/2  to  the  right. 

This  organization  is  called  Hex-odd  (Hex-even)  in  IPL. 
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The  domain  from  which  pictures  may  be  selected  in  IPL 
is  defined  using  the  following  domains: 

Pat:  {the  discrete  set  of  values  allowed  for  the 

image  samples} 

Organizations:  {orthogonal,  hex-even,  hex-odd} 

Index:  {Values  used  to  specify  a  location  in  or 

around  a  picture  or  mask} 

Coordinates  (C) :  { <m, n> | <md+kd , nd>  are  the 

coordinates  of  the  samples  in  the  image,  m 
and  n  e  Index,  and  k  is  determined  as 
follows  - 

If  organization  is  orthogonal  then  k=0? 

If  organization  is  hex-even  then  k=0  when  m  is 
odd  and  k=l/2  when  m  is  even; 

If  organization  is  hex-odd  then  k=l/2  when  m  is 
odd  and  k=0  when  m  is  even.} 

The  domain  for  pictures  is 

Picture  (P) :  {<S,  0p> | S  e  {p^j  |<i,j>  e  Coordinates 

and  there  exists  a,  b,  c,  and  d  e  Index 
such  that  if  a<=i<=b  and  c<=j<=d 
then  p^j  «  Pat}  and  Op  «  Organizations}. 
Thus,  in  order  to  specify  a  picture  domain  in  IPL  one  must 
specify  its  Pat  domain.  Coordinate  domain,  and  organization. 
The  Coordinate  domain  is  specified  by  stating  the  Index 


domain. 
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The  IPL  picture  is  a  two-dimensional  array  and  allows 
the  usual  array  operations  of  component  selection  and 
assignment.  Often,  operations  on  a  picture  require  values 
which  are  not  in  the  sampled  portion  of  the  image.  These 
values  are  required  when  performing  operations  that  use  the 
value  of  "neighboring"  elements  such  as  determining  the 
average  of  a  picture's  values  within  a  specified  radius  of 
each  element.  Such  operations  will  not  have  a  complete  set 
of  pictv  e  values  when  they  are  applied  to  Pat  locations 
which  are  "near"  (within  the  specified  radius)  the  edge  of 
the  picture.  Those  Pat  locations  which  are  outside  the 
sampled  area  of  the  image  but  must  have  defined  values  for 
certain  operations  are  defined  to  be  in  the  border  of  the 
IPL  picture. 

The  values  assigned  to  border  elements  are  usually  an 
identity  element  for  the  kind  of  operation  being  performed, 
such  as  the  additive  identity  (zero)  for  a  linear 
combination.  In  general,  however,  these  border  elements  may 
take  on  any  Pat  value  (such  as  the  value  of  the  "nearest" 
available  image  element) .  The  normal  method  of  handling  the 
border  in  digitized  image  processing  is  to  assign  some 
constant  value  to  it.  However,  since  the  border  value  is 
usually  the  additive  identity  for  some  operation,  it  is  too 
restrictive  to  require  it  to  be  a  constant  in  the  image. 
Instead,  the  border  value  should  be  a  parameter  for  any 
operation  reauiring  it.  Also,  the  border  value  should  not 
be  limited  to  constant  values.  Indeed,  when  working  with  a 
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mosaic  of  several  pictures  the  desired  border  value  may  be  a 
Pat  value  from  a  neighboring  picture.  A  function 
description  provides  the  most  general  form  of  specifying  a 
border  value  whether  it  is  a  constant  or  a  Pat  value  from 
another  picture.  Thus,  in  IPL,  Border_Value  is  a  function 
which  is  a  parameter  for  any  operation  which  might  require. 

Border_Value:  C  x  P  ♦  Pat. 

Allowing  the  Border_Value  function  to  be  a  parameter  for  an 
operation  both  highlights  its  importance  to  the  operation 
and  allows  a  change  in  the  method  of  computing  a  border 
value  for  a  particular  operation  without  affecting  other 
operations . 


Mask 

An  object  similar  to  a  picture  which  is  also  used  in 
image  processing  is  a  mask.  Informally,  a  mask  is  a 
neighborhood  of  some  Pat,  p^,  where  the  elements 
of  the  mask  are  typically  the  neighbors  of  P^j- 
A  mask  is  used  to  define  operators  on  a  Pat,  P^j» 
which  is  called  the  center  of  the  mask  in  IPL.  These 
operations  calculate  a  new  Pat  value  for  the  mask  center 
based  on  the  values  of  neighboring  Pats.  The  mask  defines 
which  Pats  affect  the  calculation  by  specifying  their 
geometric  relationship  to  the  Pat  center.  Thus  a  mask  must 
have  the  same  organization  as  some  picture,  P,  to  which  it 
is  applied.  The  elements  of  a  mask  may  or  may  not  be  Pat 
values.  Typically  a  mask  may  define  the  coefficients  for 
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some  linear  combination  of  the  neighbors  of  its  center,  so 
the  values  of  the  elements  of  the  mask  are  the  coefficients, 
and  not  the  Pat  values  themselves.  A  Mask  which  has 
elements  from  a  Pat  domain  is  called  a  Pat_Mask.  In  IPL, 
the  Pat_Mask  is  a  structural  object  used  by  a  function  to 
calculate  a  new  value  from  the  values  of  "nearby"  Pats. 

Thus,  the  mask  operation  can  be  any  function  which  uses  the 
values  from  a  Pat_Mask  and  returns  a  Pat  value.  This  allows 
a  wide  range  of  functions,  including  nonlinear  and 
discontinuous . 

Structurally  a  mask  and  a  picture  are  identical;  the 
difference  between  the  two  objects  is  in  their  semantics. 

The  conversion  from  a  mask  domain  to  a  picture  domain  (and 
vice  versa)  is  straightforward  due  to  this  structural 
equivalence.  Thus  any  operations  defined  for  picture 
objects  can  be  applied  to  mask  objects  once  they  are 
converted  to  pictures.  The  reason  for  creating  masks  as 
separate  objects  in  IPL  is  that  they  are  used  quite 
differently  from  pictures  to  describe  an  image  processing 
algorithm.  A  picture  is  the  object  on  which  an  algorithm 
(operation)  acts  while  a  mask  is  an  object  which  defines  the 
algorithm  (operation) .  Typically  a  mask  will  have  fewer 
elements  than  a  picture  over  which  it  operates,  but  this  is 
not  a  restriction.  By  separating  the  uses  of  picture-like 
objects  into  those  objects  which  define  an  operation  (mask) 
and  those  which  are  acted  on  by  the  operation  (picture)  the 
expression  of  algorithms  is  clearer. 
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The  conversion  between  picture  and  mask  domains  is  only 
allowed  when  they  both  have  elements  from  the  same  Pat 
domain.  The  Sobel  operator  described  in  Chapter  6  has  an 
example  of  this  conversion  and  its  usefulness. 

Regions 

A  segment  is  another  important  object  in  image 
processing.  In  IPL  an  object  of  type  region  is  used  to 
model  a  segment.  Generally,  a  segment  is  a  subset  of  an 
image  that  is  formed  using  a  rule  for  the  inclusion  of 
points  in  the  segment.  Generally,  the  rules  for  inclusion 
of  a  point  in  a  segment  take  the  form  of  a  range  of 
allowable  values  (both  actual  or  calculated  using  a  mask) . 

If  a  point  has  a  value  in  the  range,  it  is  included  in  the 
segment. 

Another  important  property  of  a  segment  is  its 
connectedness.  Although  the  defintion  of  a  segment  does  not 
inherently  define  this  property,  many  operations  on  a 
segment  use  its  connectedness.  The  connectedness  of  a 
segment  is  defined  in  terms  of  the  adjacency  of  two  points 
in  the  segment.  Given  a  segment,  if  each  point  in  the 
segment  is  adjacent  to  some  other  point  in  the  segment,  then 
the  segment  is  connected.  Adjacency  is  generally  defined  by 
describing  the  geometric  relationship  which  exists  between 
two  points  which  are  adjacent.  In  IPL  the  connectedness 
property  is  specified  by  describing  an  adjacency  function. 
The  adjacency  function  is  then  a  parameter  for  any  operation 
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requiting  the  connectedness  property.  Although  in  general 
any  function  which  maps  a  pair  of  coordinates  into  a  Boolean 
value  defines  an  adjacency  rule  (C  x  C  -*■  Boolean)  ,  in 
practice  only  three  such  functions  are  commonly  used.  One, 
6-connected,  is  for  hexagonal  organizations;  and  two, 
4-connected  and  8-connected,  are  for  orthogonal 
organizations.  The  set  of  adjacencies  available  in  IPL  is 
Adjacencies  (A):  {a  | 

if  0  e  {hex-even,  hex-odd}  then  A  =c6 
p  1  ‘  r 

else  if  0^  =  orthogonal  then  A^  e  {c4,c8}}. 

The  definiton  of  these  adjacencies  carries  their 
conventional  meaning  and  their  definition  can  be  found  in 
Rosenfeld  and  Kak  (1976,  p.  335). 

In  IPL,  an  object  of  type  Region  is  used  to  model  a 
segment.  A  region  is  a  subset  of  the  Pats  in  some  picture. 
The  picture  used  to  define  a  region  ia  a  part  of  the  region 
object;  the  picture  itself,  however,  remains  distinct  from 
the  region.  The  relationship  between  a  region  and  the 
picture  from  which  it  is  derived  can  be  thought  of  as  making 
a  copy  of  the  picture.  This  permits  changes  to  the  region 
which  do  not  affect  the  picture  and  vice  versa,  thus  many 
constraints  on  the  permissible  operations  on  regions  are 
avoided.  The  picture  and  region  objects  become  independent 
of  each  other  and  users  may  make  changes  to  either  regions 
or  pictures  without  having  to  consider  their  origin  or 
relationship  to  other  regions  or  pictures.  In  addition,  the 
region's  underlying  picture  defines  a  limited  domain  for 
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operations  between  two  regions  (see  Region  Operations).  The 
domain  of  a  region  R  from  picture  P  is  formally  defined  as 
Region  (R)  :  { <T[, ,  Pf,  0r>|  Pf  =  <S  ,  °p>  €  Picture, 

T  is  a  subset  of  S  ,  and  0  =  0  } 
r  p  r  pJ 

Boundary 

Another  object  used  in  image  processing  which  is 
available  in  IPL  is  the  boundary  of  a  region.  Informally, 
the  boundary  of  a  segment  in  an  image  is  the  line  which 
separates  points  in  the  segment  from  points  not  in  the 
segment.  Since  the  Pats  in  IPL  are  digitized 
representations  of  points  in  the  image,  a  boundary  of  a 
region  can  be  represented  as  a  collection  of  the  Pats  which 
are  in  the  region  but  adjacent  to  a  Pat  not  in  the  region 
(in  the  region's  complement).  The  assumption  that  Pats  are 
representaions  of  points  in  the  image  is  important  to  this 
representation.  If  the  Pats  are  not  good  approximation  of 
point  values  but  represent  areas  of  the  image  instead,  a 
better  method  of  describing  a  boundary  would  use  different 
objects.  As  an  example  of  the  kind  of  object  which  might  be 
used,  a  boundary  could  be  represented  by  a  collection  of  the 
points  in  the  digitized  image  which  are  formed  when  the 
areas  of  four  Pats  meet.  But,  since  we  have  assumed  Pats  to 
be  representations  of  points  in  the  image,  the 
representation  of  a  boundary  by  a  collection  of  Pats  is  the 
best  representation.  Thus,  the  boundary  3  of  region  R  is 
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Boundary  (B) :  {<Ub,  0fe,  Ab> | 

Rb  =  <Tr,  Pc,  0r>  e  Regions,  0fa  =  0  , 
if  0^  t  {hex-even,  hex-odd}  then  =  c6, 
if  0^  =  orthogonal  then  Ab  e  {c4,  c8}, 
and  Ub  =  {<x,z>|z  e  Class  where  for  x  t  T 
there  exists  y  e  T  '  such  that 
Ab(x,y)  =  True} } 

where  Class:  {boundary,  limit}  and 
Tf  '  is  the  complement  of  T  . 

The  {boundary,  limit}  classifications  of  the  Pats  which  are 
on  the  boundary  correspond  to  Pats  which  are  either  on  the 
boundary  or  to  Pats  which  do  not  have  enough  information  in 
the  picture  that  the  region  is  derived  from  to  determine 
whether  the  Pat  is  on  the  boundary  or  not.  These  "limit" 
Pats  are  located  on  the  edge  of  the  picture  and  the  values 
of  some  of  these  Pat’s  adjacent  Pats  are  unknown  (Pat  b  in 
Figure  1) .  A  limit  Pat  may  be  on  the  boundary  of  a  region 
or  it  may  not,  depending  on  whether  the  unknown  Pats  are  in 
the  region  or  not.  Since  a  particular  application  may  not 
treat  these  points  the  same  as  points  that  are  on  the 
boundary,  this  differentiation  must  be  made. 

o  o  x  z  x  o  o 

o  o  x  x  x  o  o 

o  o  o  o  o  o  o 

FIGURE  1:  Boundary  and  Limit  Classifications. 

Pats  x,  and  z  are  in  a  region.  Pats  labeled  x  are 
on  the  ooundary  of  the  region  but  Pat  z  cannot  be 
classified  as  on  the  boundary  based  on  the 
information  available  in  the  Qicture.  Therefore 
Pat  z  is  classified  as  a  limit  Pat  of  the  boundary. 


Note  that  the  adjacency  used  to  specify  a  boundary  does 
not  define  a  constraint  on  the  adjacency  between  elements  of 
the  boundary.  In  fact  if  8c  defines  the  boundary  members, 
then  these  members  will  be  connected  under  4c  while  if  4c 
defines  the  members  then  a  connected  boundary  may  be 
connected  only  under  8c.  {Bear  in  mind  that  if  two 
coordinates  are  connected  under  4c  they  are  also  connected 
under  8c  but  not  vice  versa)  (Rosenfeld  and  Kak,  1976).  The 
boundary  may  even  have  collections  which  have  no  two 
elements  adjacent  under  any  of  the  given  rules. 

As  with  the  relationship  between  region  and  picture,  a 
boundary  is  defined  for  a  specific  region  and  the  creation 
of  a  boundary  object  can  be  viewed  as  creating  a  copy  of  the 
underlying  region.  Thus  the  values  in  a  region  may  be 
changed  without  affecting  any  boundary  objects  that  it  has 
defined.  The  boundary  differs  from  the  region  in  that 
neither  Pat  values,  Region  membership,  nor  Boundary 
membership  may  be  changed  once  a  Boundary  object  has  been 
created.  In  order  to  make  these  kinds  of  changes,  the 
Region  object  must  be  changed  and  then  a  boundary  of  the  new 
region  created.  These  restrictions  are  required  in  order  to 
insure  that  the  Boundary  object  continues  to  represent  a 
Boundary.  Thus,  Region  membership  and  Pat  values  are  fixed 
in  a  Boundary  object. 
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H i stogr am 

A  histogram  is  an  object  used  in  image  processing  to 
represent  the  frequency  with  which  each  Pat  value  occurs  in 
a  picture.  Since  the  values  allowed  for  a  Pat  form  a 
discrete  set,  then 

Histogram  (H) ;  (<p,i>|p  e  Pat,  i  e  Positive  Integer; 

and  for  all  x  «  Pat,  there  exists  at  most  one  y 
such  that  <y ,  i>  «  H}  . 

This  definition,  however,  does  not  always  represent  the 
information  desired  by  a  user.  For  example,  when  the  Pat 
domain  is  the  same  as  some  computer  *s  domain  of 
approximations  to  Real  numbers  the  user  may  not  wish  to  have 
the  number  of  times  each  Real  value  occurs  but,  instead,  the 
number  of  times  a  value  occurs  in  some  range  of  the  Pat 
values.  (This  domain  does  form  a  discrete,  albeit  large, 
set) .  In  this  case  the  histogram  is  generally  formed  by 
mapping  the  allowable  Pat  values  into  some  smaller  discrete 
set,  for  example  integers  within  a  certain  range,  and  then 
forming  the  histogram  for  these  values.  Thus  the  general 
definition  of  a  histogram  in  IPL  is 

Histogram  (H) :  {<e,i>|e  «  a  discrete  set  (D) 

and  i  e  Positive  Integers,  and  for  each  x  e  D 
there  exists  at  most  one  <x,i>  e  h}. 
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CHAPTER  THREE 
IPL  OPERATIONS  AND 
THE  "FOR  EACH"  CONTROL  STRUCTURE 


Several  operations  which  define  mappings  over  the 
picture,  mask,  region,  and  boundary  domains  are  defined  in 
this  chapter.  Also  defined  are  a  collection  of  operations 
which  construct  a  registration  between  two  IPL  objects.  In 
addition  to  these  operations  one  control  structure,  "For 
Each",  is  defined.  This  control  structure  improves  the 
readability  of  a  sequence  of  operations  which  are  applied  to 
every  member  of  a  set. 

Picture  Operations 

In  this  section  four  basic  operations  on  pictures  are 
described.  Three  of  these  operations,  Picture_Binary_Oper- 
ations,  Picture_Unary_Operations ,  and  Fly  have  incomplete  or 
generic  descriptions  which  require  the  user  to  fill  in 
certain  details  before  they  can  be  used.  The  other 
operation,  Rotate_90,  is  completely  described.  The  reason 
only  generic  descriptions  of  the  first  two  operations  are 
given  is  because  most  operations  on  pictures  are  not  closed 
with  respect  to  a  single  domain  for  Pats.  In  fact,  there 
are  very  few  operations  which  are  performed  within  a  single 
Pat  domain.  Typically  a  picture  will  enter  an  algorithm 
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with  a  limited  Pat  domain  caused  by  limited  sensor  or 
transmission  medium  bandwidths.  Taking  an  edge  detection 
algorithm  as  an  example,  this  picture  might  then  be  mapped 
into  a  real  or  integer  domain,  which  would  then  be  mapped 
into  a  boolean  domain  for  registration  of  the  edges,  and 
finally  mapped  into  still  another  limited  domain  for  output 
(such  as  to  a  video  display) .  Clearly  it  is  not  possible  to 
define  all  of  these  operations  without  precise  descriptions 
of  all  the  domains  and  mappings  between  them.  Indeed,  these 
precise  definitions  are  the  major  effort  when  defining  an 
image  processing  algorithm.  Thus  the  generic  descriptions 
which  follow  provide  a  framework  for  specifying  the 
different  domains  and  mappings. 

In  the  descriptions  which  follow,  PI,  P2 ,  and  P3 
represent  pictures  with  Pat  values  from  domains  PDl,  PD2 , 
and  PD3  respectively.  PDl,  PD2 ,  and  PD3  may  be  distinct  or 
identical  domains. 


Picture  Unary  Operations:  Pi  •*  P3 


The  unary  operation  takes  a  single  picture  and  maps  it 
into  another  picture.  The  mapping  is  defined  by  a  user 
defined  mapping  from  PDl  *  PD3 .  Each  Pat  is  operated 
on  independently.  PI  and  P3  each  have  the  same  number  of 
Pats  and  organization  although  they  do  not  need  to  have 
identical  indices.  An  example  of  a  unary  operation  is  the 
mapping  of  one  boolean  picture  into  another  boolean  picture 
by  applying  a  "not"  operation  to  each  individual  Pat. 
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Picture  Binary  Operation:  PI  x  P2  ■>  P3 

The  binary  operation  takes  a  two  pictures  and  maps  them 
into  another  picture.  The  mapping  is  defined  by  a  user 
defined  mapping  from  PDj.  x  PD2  ■+  PD3 .  The  Pats  in  PI 


are  combined  with  the  Pats  in  P2  which  are  in  a  similar 


location,  i.  e.,  the  Pat  in  Pi's  first  row  and  first  column 
is  combined  with  the  Pat  in  P2's  first  row  and  first  column 


to  yield  the  Pat  in  P3's  first  row  and  first  column.  PI, 

P2,  and  P3  all  have  the  same  number  of  Pats  and  organization 
although  they  do  not  need  to  have  identical  indices.  An 
example  of  a  Picture_Binary_Operation  is  to  divide  one 
integer  picture  by  another  integer  picture  to  give  a  real 
valued  picture. 


Rotate  90:  PI  x  Positive  Integer  -  PI 

This  operation  returns  a  picture  with  the  same  number 
of  elements,  organization,  and  Pat  domain  as  the  input 
picture.  The  operation  moves  the  value  in  the  input  picture 
at  location  <Pl'First(l)  +  i,  Pl'First(2)  +  j>  to 
<P2'First(l)  +  j,  P2'Last(2)  -  i>.  First(l)  and  First(2) 
represent  the  picture's  first  row  and  column  index  value 
respectively;  Last(2)  represents  the  picture’s  last  column 
index  value.  This  "exchange"  is  repeated  the  number  of 
times  specified  by  the  positive  integer. 


Masks  may  be  used  to  transform  one  picture  into 
another.  In  IPL  this  operation  is  called  Fly.  The  Fly 
operation  computes  a  new  picture  from  an  old  picture  based 
on  the  transformation  defined  by  a  Mask_Operation.  As  for 
Picture  operations,  Fly  may  be  defined  for  pictures  with 
different  domains. 

The  Fly  function  creates  a  new  picture  by  computing  a 
new  Pat  value  in  the  Mask_Oper ation  specified  when  the  Fly 
function  is  created.  The  Mask_Operation  is 

Mask_Operation:  Maskl  x  Mask2  ■*  PD3 . 

Fly  fills  a  mask  with  Pat  values  from  the  input  picture 
Pi  which  have  the  same  positional  relationship  with  respect 
to  the  Pat  value  being  calculated  as  the  mask  coordinates  do 
with  respect  to  the  input  center  coordinates  (C) .  The  size 
of  this  mask  is  identical  to  the  size  of  the  mask  input  to 
Fly.  Fly  then  calls  the  Mask_Operation  with  the  mask  filled 
from  Pi  and  the  mask  input  to  Fly  to  get  a  new  Pat  value. 
Thus  the  Mask_Oper ation  is  always  given  masks  of  equal  size. 
By  repeating  this  procedure  for  each  Pat  in  the  Picture  a 
new  picture  is  generated.  Fly  also  calls  a  Border_Value 
function  to  determine  a  Pat  value  when  a  value  outside  the 
picture  is  required.  A  similar  Fly  operation  is  available 
for  regions  with  restricted  mask  domains  and  operations. 

A  common  Mask_Operation  found  in  image  processing  is 
the  linear  combination  of  the  Pats  in  the  two  input  masks. 
This  operation  is  the  sum  of  the  elements  of  the  binary 
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product  of  the  two  masks.  (The  binary  product  of  two  masks 
is  equivalent  to  a  Picture_Binary_Operation  where  the 
operation  is  the  product  of  two  Pats) .  The  definiton  of 
linear  combination  in  this  manner  requires  that  the  masks  be 
of  the  same  size,  that  the  product  PD1  x  PD2  ■»  PD3  is 
defined,  and  that  addition  is  defined  over  PD3 .  An 
instance  of  the  function  requires  the  user  to  specify 
the  domains  for  the  masks  and  for  the  output,  and  to  insure 
that  the  above  operations  are  defined. 

The  mask  operations  can  be  used  to  define  many  common 
image  processing  operations  such  as  filtering, 
differentiation,  texture  edge  enhancement,  Sobel  edge 
enhancement,  and  template  matching  by  cross  correlation. 
Examples  of  these  operations  written  in  the  Ada 
implementation  of  IPL  are  given  in  Chapter  5. 

Region  Operations 

Eleven  basic  operations  are  available  for  a  region: 
Pat_Value,  Make_Pat_Region,  Make_Region,  In_Region,  Union, 
Intersection,  Difference,  Complement,  Picture_Of, 
Region_Binary_Operation,  and  Region_Fly.  Each  operation  is 
described  below. 

Pat  Value:  R  x  C  ■»  Pat 

This  operation  returns  the  value  of  the  Pat  located  at 
the  given  coordinates  in  the  region.  A  Constraint_Er ror 
occurs  if  the  given  coordinates  are  not  within  the  bounds  of 
the  region. 
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Make  Pat  Region:  Pat  x  C  ■»  R 

This  operation  creates  a  region  object  from  a  picture 
ooject  and  the  coordinates  of  a  Pat  in  the  picture.  A 
Constr aint_Er ror  occurs  if  the  given  coordinates  are  not 
within  the  bounds  of  the  region. 

Make  Region:  P  x  Boolean  Picture  -  R 

This  operation  creates  a  region  object  from  a  picture 
object  and  another  picture  of  equivalent  size  and  index 
values  but  with  boolean  elements  (Boolean_Picture) .  Those 
elements  in  the  Boolean_P icture  with  a  value  of  True  are 
placed  in  the  output  region  object  while  False  locations  are 
not  included. 

In  Region;  R  x  C  •*  Boolean 

In_Region  returns  True  if  the  given  coordinates  are  in 
the  given  region  and  False  otherwise.  A  Constr aint_Er ror 
occurs  if  the  given  coordinates  are  not  within  the  bounds  of 
the  region. 

Union  "  +  "  ;  RxR-»R 

This  operation  returns  the  region  which  contains  all 
Pats  in  either  of  the  two  input  regions.  The  two  input 
regions  must  be  formed  from  the  same  picture  or  an 
Incompatible_Regions  error  will  occur.  The  output  region 
will  be  formed  from  the  input  regions'  underlying  picture. 
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Intersection  R  x  R  -»  R 

This  operation  returns  the  region  which  contains  all 
Pats  in  both  of  the  two  input  regions.  The  two  input 
regions  must  be  formed  from  the  same  picture  or  an 
Incompatible_Regions  error  will  occur.  The  output  region 
will  be  formed  from  the  input  regions'  underlying  picture. 

Difference  R  x  R  -  R 

The  difference  operation  returns  the  region  with  Pats 
in  the  first  input  region  but  not  in  the  second  input 
region.  The  two  input  regions  must  be  formed  from  the  same 
picture  or  an  Incompatible_Regions  error  will  occur.  The 
output  region  will  be  formed  from  the  input  regions' 
underlying  picture. 

Complement:  R  •»  R 

This  operation  returns  a  region  over  the  same  picture 
as  the  input  region  but  whose  members  are  not  in  the  input 
region. 

Picture  Of:  R  -  P 

This  operation  returns  the  underlying  picture  of  the 
given  region. 

Region  Binary  Operation:  R  x  P  •*  R 

The  Region_Binary_Operation  provides  the  capability  to 
combine  a  region  object  with  a  picture  object  to  form  a  new 
region.  The  inputs  must  be  of  the  same  size  or  a 
Constraint  Error  will  occur.  The  output  region  will  be 
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formed  from  the  input  region’s  underlying  picture. 
Membership  in  the  output  region  is  determined  by  applying  a 
user  supplied  function  which  maps 


Boolean  x  Pat  -*  Boolean. 

The  function  is  applied  to  similarly  located  values  of  the 
two  inputs  just  as  in  Picture_Binary_Operations. 

Region  Fly:  R  x  BMP  x  Mask  x  C  x  Border  Value  •*  R 

The  Region_Fly  operation  provides  the  capabilty  to 
calculate  a  new  region  based  on  whether  nearby  Pats  are  in 
the  region  or  not.  The  Boolean_Mask_Operation  (BMO) 
supplied  by  the  user  provides  this  mapping  and  is  of  the 
form 

Boolean_Mask  x  Mask  ■*  Boolean. 

This  operation  calls  a  Border_Value  function,  just  as  the 
Fly  operation  did,  to  determine  region  membership  values  for 
Pats  which  are  not  in  the  picture  used  to  define  the  region 
but  whose  values  are  required  for  Fly  to  complete.  The 
output  region  will  have  the  same  underlying  picture  as  the 
input  region  and  will  have  members  which  have  True  results 
from  the  BMO.  The  Boolean_Mask  will  be  filled  by  the 
Region^Fly  operation  similar  to  the  manner  used  in  the  Fly 
operation  to  fill  its  Pat_Mask. 

Boundary  Operations 

The  basic  operations  available  for  a  boundary  are: 
Pat_Value,  In_Region,  Make_Boundary ,  On_Boundary,  Next_Pat, 
and  Region_Of.  These  5  basic  operations  can  be  used  to 
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define  other  operations  on  boundaries  such  as  length,  slope, 
or  curvature.  In  addition,  a  boundary  can  be  converted  to  a 
region  with  the  same  elements  and  then  any  of  the  region 
operations  can  be  applied  to  the  equivalent  region  object. 

Pat  Value:  B  x  C  -»■  Pat 

This  operation  returns  the  value  of  the  Pat  located  at 
the  given  coordinates  in  the  picture  from  the  region  used  to 
define  the  boundary.  If  the  coordinates  are  not  within  the 
picture  then  a  Constraint_Er ror  will  occur. 

In  Region;  B  x  C  ■*  Boolean 

In_Reg ion  returns  True  if  the  given  coordinates  are 
within  the  region  used  to  define  the  boundary.  If  the 
coordinates  are  not  within  the  bounds  of  the  region  then  a 
Constraint_Er ror  will  occur. 

Make  Boundary  (MB)  :  R  x  A  -»•  B 

This  operation  creates  a  boundary  object  from  the  given 
region  using  the  specified  adjacency  and  the  definition  of  a 
boundary. 

On  Boundary:  B  x  C  -»•  Class 

On_Boundary  returns  the  classification  of  the  Pat 
located  at  the  given  coordinates  within  the  boundary.  A 
Constr aint_Er ror  occurs  whenever  the  coordinates  are  not 
within  the  bounds  of  the  underlying  region. 
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Next  Pat:  B  x  C  x  C  x  Ax  Direction  -»  C,  Where 

Direction  {Clockwise,  Counterclockwise} 

Next_Pat  provides  a  method  of  traversing  a  boundary  by 
stepping  between  Pats  which  are  on  the  boundary  or  are  limit 
Pats.  Steps  are  made  only  between  Pats  which  are  adjacent 
under  the  given  adjacency  rule.  An  algorithm  for  performing 
this  border  following  is  described  in  detail  in  Rosenfeld 
and  Kak  (1976  p.  342).  The  direction  indicates  whether  the 
next  step  is  to  be  taken  in  a  clockwise  or  counterclockwise 
direction.  Two  coordinates  are  required;  one  designates 
the  Pat  from  which  the  step  is  to  be  made  while  the  other 
indicates  the  Pat  from  which  the  search  for  the  next  Pat  is 
to  be  initiated.  The  later  Pat  must  be  at  least  c8  adjacent 
(c6  for  Hex  organizations)  to  the  former  Pat.  The  Pat  from 
which  the  step  is  to  be  made  must  be  either  on  the  boundary 
or  a  limit  Pat.  The  Pat  from  which  the  search  is  initiated 
may  be  of  any  classification.  (The  Pat  visited  one  step 
back  guarantees  that  the  boundary  will  be  traversed 
completely. ) 

The  border  following  algorithm  used  has  no  memory  of 
which  Pats  have  been  visited  but  merely  calculates  the  next 
Pat  based  on  the  given  information.  Thus  this  operation 
will  always  return  the  coordinates  of  a  Pat  classified  as  On 
or  Limit.  Users  must  remember  where  they  have  been  and 
decide  when  they  have  visited  every  Pat  on  the  given 
boundary.  Some  boundaries  may  have  Pats  that  will  be 
visited  as  many  as  three  times  before  all  Pats  have  been 
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visited.  In  addition,  this  operation  will  not  jump  to 
disconnected  boundary  segments  within  the  same  boundary 
object.  Finally,  the  operation  visits  only  the  minimum 
number  of  Pats  required  to  traverse  the  given  boundary  under 
the  given  adjacency.  It  is  possible  that  some  Pats  may  not 
be  visited.  For  example,  if  the  boundary  was  created  with  a 
c8  adjacency  rule  and  then  traversed  with  the  same  rule,  not 
every  member  of  the  boundary  must  be  visited  to  define  a 
connected  path.  Figure  2  shows  an  example  of  this 
situation . 


ooooaooo 
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FIGURE  2:  Border  Following  Around  a  Closed  Boundary. 
In  this  picture  Pats  labeled  as  a,  c,  or  v  are  in  a 
region.  Pats  labeled  as  a  are  on  the  c4  boundary 
while  Pats  labeled  as  a  or  c  are  on  the  c8  boundary, 
a  traversal  of  the  c8  boundary  using  steps  between 
Pats  which  are  c8  adjacent  would  visit  only  the  a 
Pats.  In  order  to  visit  both  the  a  and  c  Pats  the 
boundary  must  be  traversed  under  c4. 


Region  Of:  B  -<•  R 

This  operation  returns  the  underlying  region  of  the 


boundary. 


In  image  processing  it  is  often  necessary  to  define  a 
relationship  between  two  images.  This  relationship 
generally  defines  the  same  or  similar  objects  within  the  two 
images.  The  objects  within  the  two  images  may  be  identical 
or  they  may  be  modified  by  a  rotation  or  scale  of  the 
object.  In  any  case  this  relationship  is  a  mapping  between 
the  points  of  the  two  images.  In  IPL,  such  a  mapping  is 
called  a  registration  (Rg) . 

Rg(p.  . )  ■*  p  ,  where  p. .  e  P  ,  p  «  P,  , 

’  rmn  *13  a  ^mn  b 

and  picture  P  is  registered  to  picture  P,  . 

cl  D 

A  registration  can  be  defined  by  either  a  functional  mapping 
of  the  coordinates  of  the  first  picture  into  the  coordinates 
of  the  second  picture,  by  an  enumeration  of  the  points  in 
the  first  picture  and  their  associated  points  in  the  second 
picture,  or  by  some  combination  of  the  two. 

In  order  to  define  the  registration  of  two  pictures  by 
an  enumerated  set  this  object  and  its  associated  operations 
must  be  defined.  The  object  is 

Set_of_Coordinate_Pairs  (SCP)  :  {o,b>| 

a,b  e  Coordinates;  a  is  the  coordinate 
of  a  Pat  in  P  to  which  b,  the  coordinates 

3 

of  a  Pat  in  Pb  is  registered;  and 

for  each  x  «  {the  coordinates  of  a  Pat  in  P  } 

there  is  at  most  one  <x,b>  e  SCP} . 

The  last  requirement  of  a  Set_of_Coordinate_Pairs  element 
allows  the  first  coordinate  in  a  coordinate  pair  to  be  an 
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index  for  that  element  and  is  the  basis  for  the 
Reg istered_Coord inates  use  of  the  set.  A 
Set_of_Coordinate_Pair s  has  the  operations  listed  in  the 
following  sections. 

Make  Coordinate  Pair  Set;  C  x  C  ■*  SCP 

This  operation  creates  a  SCP  object  from  two 
coordinates.  The  coordinates  must  designate  Pats  of  the 
pictures  which  defined  the  SCP  or  a  Constr aint_Er ror  occurs. 

Union  SCP  x  SCP  -  SCP 

This  operation  returns  the  SCP  which  contains  all 
registered  coordinates  in  either  of  the  two  input  SCPs.  If 
<a,x>  is  in  one  of  the  input  SCPs  and  <a,y>  is  in  the  other, 
then  x  =  y  or  an  Inconsistent_Registration  error  occurs.  An 
Inconsistent_SCP  error  occurs  if  the  two  input  SCPs  are  not 
defined  over  the  same  pictures. 

Difference  SCP  x  SCP  -SCP 

The  difference  operation  returns  the  SCP  with 
registered  coordinates  in  the  first  input  SCP  but  not  in  the 
second  SCP.  If  <a,x>  is  in  one  of  the  input  SCPs  and  <a,y> 
is  in  the  other,  then  x  =  y  or  an  Inconsistent_Registration 
error  occurs.  An  I  neons i stent_SCP  error  occurs  if  the  two 
input  SCPs  are  not  defined  over  the  same  pictures. 
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Intersection  SCP  x  SCP  -»  SCP 

This  operation  returns  the  SCP  which  contains  all 
registered  coordinates  in  both  of  the  two  input  SCPs.  If 
<a,x>  is  in  one  of  the  input  SCPs  and  <a,y>  is  in  the  other, 
then  either  x  =  y  and  <a,x>  will  be  in  the  output  SCP  or  an 
Inconsistent_Registration  error  occurs.  An  Inconsistent_SCP 
error  occurs  if  the  two  input  SCPs  are  not  defined  over  the 
same  pictures. 

Registered  Coordinates:  SCP  x  C  ■*  C 

This  operation  returns  the  coordinates  which  are 
registered  to  the  input  coordinates  in  the  input  SCP.  A 
Constr a int_Er ror  occurs  if  the  input  coordinates  do  not 
designate  a  Pat  of  the  from-picture  (P  )  of  the  SCP. 

Change  Registered  Coordinates;  SCP  x  C  x  C  -  SCP 

This  operation  changes  the  pair  of  coordinates  in  the 
input  SCP  to  the  pair  designated  by  the  input  coordinates. 

If  <a,b>  represents  the  input  coordinate  pair  then  a  must 
designate  a  Pat  in  the  from-picture  (P  )  and  b  must 
designate  a  Pat  in  the  to-picture  (P^)  or  a  Constraint_Er ror 
will  occur.  This  operation  can  be  defined  in  terms  of  the 
previously  defined  operations. 
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"For  Each"  Control  Structure 

In  adddition  to  the  basic  control  structures  available 
in  most  high  level  programming  languages,  and  specifically 
those  available  in  Ada,  one  additional  control  structure  for 
IPL  is  desirable.  This  control  structure  defines  a  loop  to 
be  repeated  for  each  element  of  a  set.  Certainly  this 
control  structure  can  be  expressed  using  "D"  type  structures 
and  will  be  defined  using  them: 

element  :=  first  element  the  set  might  contain; 

Done  :=  False; 

While  Not  Done  Loop 

If  element  in  set  Then 

Block  of  statements  operating  on  element 
Endlf 

If  element  is  the  last  one  in  the  set  Then 
Done  :=  True 

Else  element  :=  next  element  which  might 
be  in  the  set 

Endlf; 

EndLoop; . 

The  "For  Each"  control  structure  is  equivalent  to  the  above 
statements  but  reduces  the  code  required  and  the  potential 
for  making  a  mistake  in  the  code.  The  syntax  of  the  For 
Each  statement  is 

For  Each  <identifier>  of  <set_identif ier >  Loop 
statement . . . 

EndLoop. 


CHAPTER  FOUR 
ADA  IMPLEMENTATION 


Appendices  A  and  3  contain  the  Ada  generic  package  for 
an  implementation  of  the  IPL  language.  Appendix  A  contains 
the  package  declarations;  appendix  B  contains  the  package 
body.  Ada  was  used  for  this  implementation  because  of  its 
generic  program  units  and  its  capability  to  package  together 
data  type  descriptions  with  their  defined  operations  while 
leaving  implementation  details  hidden.  The  generic 
capability  permits  the  definition  of  a  program  template  from 
which  (nongeneric)  program  units  can  be  obtained.  This 
permits  the  creation  of  a  program  which  can  operate  on  a 
class  of  data  types  without  writing  a  separate  program  for 
each  distinct  type.  The  picture  binary  and  unary  operations 
are  excellent  examples  of  generic  functions.  These  two 
functions  operate  on  pictures,  a  class  of  two  dimensional 
arrays  with  unspecified  individual  elements.  An  actual 
binary  function  can  be  created  by  specifying  the  kind  of 
elements  in  the  picture  and  the  way  in  which  these  elements 
are  to  combined.  The  Ada  generic  unit  also  provides  an 
indirect  method  for  passing  a  function  name  as  a  parameter 
to  a  function.  This  capability  is  used  in  almost  all  of  the 
generic  units  but  was  the  primary  reason  for  making  the  Fly 
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functions  generic.  The  generic  capabi.ltiy  of  Ada  was  most 
useful  in  creating  this  implementation  of  IPL.  In  fact,  the 
entire  implementaion  is  a  generic  package  which  can  create 
several  different  image  processing  packages  for  distinct  Pat 
domains.  Binary,  unary,  and  Fly  operations  can  then  be 
specified  to  define  how  these  different  domains  can  be 
mapped  to  one  another,  if  at  all. 

It  is  also  important  to  note  that  Ada  effectively  hides 
the  implementations  of  the  various  IPL  operations  from  users 
resulting  in  two  advantages.  First,  a  user  of  the  language 
can  write  in  IPL  by  using  the  declaration  section  of  the  IPL 
generic  package  for  the  syntax  of  the  language,  and  the 
language  description  as  the  semantics  of  the  language.  This 
contributes  to  the  portability  of  the  code  by  inhibiting  the 
use  of  implementation  details.  Second,  the  implementations 
of  the  operations  and  the  private  data  types  (regions  and 
boundaries)  can  be  changed  without  affecting  the  correctness 
of  algorithms  written  in  the  language  as  long  as  the 
algorithms  do  not  rely  on  side  effects  for  correctness  and 
the  new  implementations  conform  to  the  IPL  semantics.  Thus 
the  given  implementations  could  easily  be  changed  or 
modified  to  take  adavantage  of  hardware  capabilities,  such 
as  assigning  multiple  processors  to  the  unary  and  binary 
operations . 

Additionally,  the  IPL  language  requires  the 
availability  of  D-type  control  structures  and  the  capabilty 
to  specify  data  type  domains  as  well  as  operations  over 
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those  domains.  By  embedding  ipl  within  Ada  these 
requirements  are  met.  A  user  of  the  language  has  full 
access  to  the  Ada  programming  language  as  well  as  the 
specialized  constructs  built  for  image  processing.  Thus  the 
image  processing  algorithms  presented  in  this  thesis  use 
several  of  the  Ada  capabilites. 

The  Ada  Programming  Language ,  ANSI/MIL-STD-1815A 
(1933) ,  is  the  source  of  information  used  to  write  this 
implementation  of  IPL  in  Ada.  No  compiler  was  available  so 
the  given  implementation  has  not  been  compiled  or  tested. 

It  is  included  here  as  a  second  description  of  the  language 
and  as  a  vehicle  to  demonstrate  the  usefulness  of  IPL  in 
stating  image  processing  algorithms.  There  are  two 
additional  benefits,  however.  First,  given  an  Ada  compiler 
the  testing  and  use  of  the  Ada  IPL  is  straightforward. 

Since  the  Ada  language  is  intended  to  be  transportable,  this 
contributes  to  a  transportable  IPL.  Second,  the 
implementation  of  IPL  in  other  languages  can  be  modeled 
directly  from  the  Ada  implementation.  Ambiguities  caused  by 
translating  the  Ada  implementation  can  be  resolved  by 
referring  to  the  more  formal  description  presented  in  this 
thesis. 

In  order  to  implement  the  "For  Each"  control  structure, 
an  additional  function  is  added  to  the  Ada  IPL.  Since  a  new 
control  structure  could  not  be  added  directly  to  the 
language  without  writing  a  precompiler  or  altering  the 
existing  compiler,  a  function  was  added  which  would  return  a 
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"next  element"  foe  those  sets  which  required  it.  To  step 
through  the  Pats  in  a  picture  is  a  direct  use  of  the  Ada 
"For"  loops  and  does  not  require  a  "Next"  function.  Also, 
the  Boundary  object  already  has  a  "Next"  function  (border 
following)  which  can  be  used  to  step  through  the  Pats  in  a 
boundary.  Regions  and  Sets_of_Coordinate_Pair s ,  however, 
require  a  "Next"  function  in  order  to  perform  the  "For  Each" 
control.  The  region  and  Set_of_Coordinate_Pairs  "Next" 
functions  are  given  coordinates  to  mark  where  they  are  in 
the  set  and  then  return  the  next  coordinates  in  the  set. 

Null  coordinates  are  returned  at  the  end  of  the  set  and  null 
coordinate  inputs  request  the  first  element  in  the  set. 

These  functions  proceed  through  the  elements  in  the  set  in 
an  unspecified  order  without  repetition. 

Finally,  the  bodies  for  the  procedures  to  input  or 
output  a  picture  are  not  included  in  the  body  of  the  IPL 
package.  The  bodies  of  these  operations  are  entirely 
dependent  upon  the  hardware  and  architecture  of  the 
implementation  and  therefore  cannot  be  defined  here. 


CHAPTER  FIVE 

ALGORITHMS  IMPLEMENTED  IN  IPL 


Several  algorithms  which  perform  common  image 
processing  tasks  are  written  in  the  Ada-IPL  and  presented  in 
this  chapter.  The  algorithms  demonstrate  IPL's  capability 
to  express  them  clearly  and  completely.  At  the  same  time 
these  algorithms  demonstrate  how  IPL  highlights  the  design 
of  the  domain  mappings  critical  to  most  image  processing. 

The  algorithms  presented  were  selected  based  on  their  common 
usage  in  image  processing  and  on  their  capability  to 
demonstrate  the  use  of  different  IPL  operations.  Thus 
readers  who  are  familiar  with  image  processing  techniques 
should  already  understand  the  intent  of  these  operations  and 
be  able  to  study  the  influence  of  IPL  on  their  clarity. 
Thresholding,  Laplacian,  differentiation,  texture  edge 
detection,  template  matching  by  cross  correlation,  linear 
and  nonlinear  filtering,  and  Sobel  edge  enhancement 
algorithms  are  presented  for  picture  operations.  Expand, 
shrink,  and  area  algorithms  are  presented  for  regions. 


38 


f  .* 


39 


Threshold 

A  threshold  algorithm  for  pictures  is  presented  in 
Figure  3  (Rosenfeld  and  Kak,  1976,  p.  258,;  Pratt,  1978 
p.  534).  The  algorithm  is  basicly  a  unary  operation  on  the 
input  picture  which  applies  a  threshold  function  to  each  Pat 
in  the  picture.  By  writing  the  Pat_Threshold  function 
within  the  declaration  section  of  Picture_Threshold  the 
additional  parameters,  threshold_values  and  output_values , 
are  visible  to  Pat_Threshold .  This  allows  the  Pat_Thr eshold 
function  to  conform  to  the  parameter  list  required  by 
Picture_Unary_Operation.  An  implementation  of  IPL  which 
allows  parameter  lists  as  well  as  function  names  to  be 
parameters  would  simplify  this  algorithm. 


FUNCTION  Picture_Threshold  (P  :  Pictures; 

Lower_Bound,  Upper_Bound, 

In_Range_Value ,  Out_Range_Value  :  Pats) 
RETURN  Pictures  is 

FUNCTION  Threshold  (Pat  :  Pats)  RETURN  Pats  is 
BEGIN 

IF  (Pat  >=  Lower_Bound)  OR  (Pat  <=  Upper_Bound) 

THEN  RETURN  In_Range_Va lue ; 

ELSE  RETURN  Out_Range_Value; 

ENDIF ; 

END  Threshold; 

FUNCTION  Threshold_Op  is  NEW  P icture_Unary_Op 

(Element_l  Element_3  =>  Pats, 

Picture_l  Picture_3  =>  Pictures, 

F  =>  Threshold) ; 

BEGIN 

RETURN  Threshold_Op (P) ; 

END  Picture  Threshold; 


FIGURE  3:  Ada-IPL  Threshold  Algorithm. 
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Laplacian 

The  Laplacian  is  a  higher-order  derivative  operator 
which  is  used  to  detect  edges  but  is  less  sensitive  to 
orientation  than  a  straight  derivative  operator  (Rosenfeld 
and  Kak,  1976,  p.  28,1;  Pratt,  1973  p.  482).  A  Lapalacian 
operation  over  a  digital  picture  can  be  defined  using  a 
linear  combination  of  floating  point  and  Pat  values.  Figure 
4  contains  the  declarations  needed  for  such  an  operation. 
Using  these  declarations,  the  Laplacian  operation  could  be 
expressed  as 

Float_Pic  :=  Float_LC_Fly  (Pat_Pic,  ((0,  1,  0) 

(1,  -4,  1) 

(0,  1,0)),  (2,  2) ) ; . 

Furthermore,  the  Float_LC_Fly  can  be  used  to  express  any 
linear  combination  of  floating  point  and  Pat  values  over 
whatever  mask  size  required. 


TYPE  Float_Mask  is  ARRAY 

(Mask_Index  RANGE  1..2,  Mask_Index  RANGE  1..2)  of 
TYPE  Float_Pictur e  is  ARRAY 

(Index  RANGE  <>,  Index  RANGE  <>)  of  Float; 
FUNCTION  Float_LC  is  NEW  Linear_Combination 

(Element_l  =>  Pats, 

Mask_l  =  >  Pat_Mask, 

Element_2  |  Element_3  =>  Float 
Mask_2  =■>  Float_Mask); 

FUNCTION  Float_LC_f ly  is  NEW  Fly 
(Mask_Index  =  >  Mask_Index, 

Element_l  =>  Float,  Mask_l  =>  Float_Mask, 
Element_2  =>  Pats,  Mask_2  =>  Pat_Mask, 

Picture_2  =>  Pictures, 

Element_3  =>  Float,  Picture_3  =>  Float_Picture , 

F  =>  Float  LC) ; 


Float; 


FIGURE  4:  Ada-IPL  Laplacian  Declarations. 
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Differentiation 

The  derivative  of  a  function  of  two  variables  can  be 
characterized  by  its  gradient.  The  gradient  is  described  by 
its  magnitude  and  direction  (Rosenfeld  and  Kak,  1976, 
p.  278).  Figure  5,  p.  42,  presents  an  Ada-IPL  algorithm  for 
computing  the  derivative  of  a  picture.  The  derivative  is 
computed  by  first  finding  the  difference  between  adjacent 
Pats  in  the  rows  and  columns.  These  are  computed  separately 
using  fly  operations.  These  two  pictures  are  then  combined 
in  a  P ictur e_B inary_Op  to  form  a  picture  with  gradients  as 
its  elements'  values. 

Texture  Edge  Detection 

The  algorithm  described  in  this  section  is  used  to 
detect  the  edges  around  objects  which  differ  from  their 
background  with  respect  to  the  average  value  of  some  local 
property  as  opposed  to  objects  which  are  characterized  by 
some  Pat  value.  The  pictures  on  which  this  algorithm  would 
be  useful  generally  have  a  large  amount  of  salt  and  pepper 
noise,  or  noise  at  both  extremes  of  the  Pat  domain 
(Rosenfeld  and  Kak,  1976,  p.  294).  The  algorithm  is  shown 
in  Figure  6,  p.  43.  The  algorithm  uses  a  variable  size  mask 
which  depends  on  the  size,  or  radius,  used  to  compute  the 
average  Pat  value.  It  then  proceeds  in  a  manner  similar  to 
the  differentiate  algorithm,  only  it  finds  the  differences 
between  the  centers  of  the  masks  used  to  compute  the  Pat 
averages  rather  than  the  differences  between  adjacent  Pats. 


t  •* 
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TYPE  Gradients  is  RECORD 

Magnitude,  Direction  :  Float; 

END  RECORD; 

TYPE  Der ivative_P ictu r es  is  ARRAY 

(Index  RANGE  <>,  Index  RANGE  <>)  OF  Gradients; 

FUNCTION  Differentiate  Picture  (P  :  Pictures) 

RETURN  Der ivative_Pictur es  is 

TYPE  Float_Mask  is  ARRAY 

(Mask_Index  RANGE  1..2,  Mask_Index  RANGE  1..2)  of  Float; 

TYPE  Float_Pictur e  is  ARRAY 

(Index  RANGE  <>,  Index  RANGE  <>)  of  Float; 

FUNCTION  Float_LC  is  NEW  Linear_Combination 

(Elemental  =>  Pats, 

Mask_l  =>  Pat^Mask, 

Element_2  |  Element_3  =>  Float, 
Mask_2  =>  Float_Mask) ; 

FUNCTION  Float_LC_f ly  is  NEW  Fly 

(Mask_Index  =>  Mask_Index, 

Elemental  =>  Float, 

Mask_l  =  >  Float_Mask, 

Element_2  =>  Pats, 

Mask_2  =>  Pat_Mask, 

Picture_2  =>  Pictures, 

Element_3  =>  Float, 

Picture_3  =>  Float_Picture , 

F  =>  Float_LC) ; 

FUNCTION  De'r ivative_Op  (Left,  Right  :  Float) 

RETURN  Gradients  is 

Dummy  :  Gradients; 

BEGIN 

Dummy .Magnitude  :=  Sqr rt (Left**2  +  Right**2) ; 

Dummy. Direction  :=  Arctan (Left/Right) ; 

RETURN  Dummy; 

END  Der ivative_Op; 

FUNCTION  Pic__Der  ivative_Op  is  NEW  picture_3inarv_0p 
(Element_l  j  Element_2  =>  Float, 

Picture_l  j  Picture_2  =>  Float_Pictures , 
Element_3  =>  Gradients, 

Picture_3  =>  Der ivative_Pictur e , 

F  =>  Der ivative_Op) ; 

Del_X, 

Del_Y  :  Der ivat ive_P ictures ( P ' RANGE ( 1 ) ,  P ' RANGE ( 2 ) ) ; 

BEGIN 


Del_X 

:=  Float 

.LC_ 

Fly 

(P, 

(  (1, 

-1) 

(0, 

0)  ) 

Del_Y 

:=  Float 

LC 

Fly 

(P, 

(  (1, 

0)  , 

(-1,  0) ) ,  (1,  1) ) ; 

RETURN  Picture_Der ivative_Op  (DeI_X,  Del_Y) ; 

END  ? icture_Der ivat ive ; 

FIGURE  5:  Ada-IPL  Differentiate  Operation 
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FUNCTION  Texture_Edge_Detection 
(P  :  Pictures; 

R  :  Index  RANGE  1 .. Index ' LAST)  --  Radius 
RETURN  Pictures  is 

—  Assumes  Pats  is  a  subtype  of  Natural  Integers 
FUNCTION  Integer_LC  is  NEW  Linear_Combination 
(Element_2  =>  Pats,  Mas!<_2  =>  Pat_Mask, 

Element_l  |  Element_3  =>  Integer, 

Mask_l  =>  Mask) ; 

FUNCTION  Integer_LC_Fly  is  NEW  Fly 
(Mask_Index  =>  Index, 

Element_l  |  Element_3=> Integer ,  Mask_l=>Integer_Mask , 
Element_2  =>  Pats,  Mask_2  =>  Pat_Mask, 

Picture_2  =>  Pictures,  Picture_3  =>  Integer_Pictures , 
F  =>  Integer_LC) ; 

FUNCTION  "/"  is  NSW  P ictur e_B inary_Op 
(Element_l  I  Element_2  j  Element_3  =>  Integer, 

Picture_l  |  Picture_2  |  Picture_3  =>  Integer_Pictures , 

f  =>  "/" ) ; 

FUNCTION  "  +  is  NEW  P ictur e_B inary_Op 

(Element_l  £lement__2  I  Element_3  =>  Pats, 

Picture_l  Picture_2  |  Picture_3  =>  Pictures, 

F  =>  "+" )  ; 

FUNCTION  Abs  (Left  :  Integer)  RETURN  Pats  is 
BEGIN 

RETURN  Pats' Abs (Left) ; 

END  Abs; 

FUNCTION  Abs  is  NEW  Pxcture_Unary_Op 

(Element_l  =>  Integer,  Picture_l  =>  Inteqer_Pictures , 
Element_3  =>  Pats,  Picture_3  =>  Pictures, 

F  =>  Abs) ; 

Texture_Mask  :  CONSTANT  Integer_Mask 

(-R..R,  -R..R)  :=  (OTHERS  => (OTHERS  =>  1)); 

Hor iz_Dif ference_Mask  :  CONSTANT  Integer_Mask 
(0..0,  -R..R)  ;=  (G  => ( -R  =>  1,  R  =>  -1,  OTHERS  =>  0 ) ) ; 

Ver t_Dif ference_Mask  ;  CONSTANT  Integer_Mask 
(-R..R,  0..0)  :=  (-R  =>  (1),  R  =>  (-1),  OTHERS  =>  (0)); 

NormaIizing_Picture  ;  CONSTANT 

Integer_P ictures  ( P ' RANGE ( 1 ) ,  P ' RANGE ( 2 ) ) 
:=  (OTHERS  =>  (OTHERS  =>  ( 2R  +  ’1**2)); 
Dummy,  Hor  iz_Di  f  f_Pic ,  Ver  t_D  i  f  f_P  ic  :  Inteae-  ’’ictures; 
BEGIN 

Dummy  :=  Integer_LC_Fly  (P,  Texture_Mask ,  (0,  C;  , 

Hor i z_Di f f_P ic  ;=  Integer  LC_Flv 

(Dummy,  Hor iz_Dlf ference_Mask ,  (0,  0)); 

Hor i z_D i f f_P ic  :=  Hor i z_D i f f_Pic/Norma 1 izing_Pictur e ; 
Vert_Dif f_Pic  :  =  Integer_LC_Fly 

(Dummy,  Vert_Dif ference_Mask ,  (0,  0)); 

Ver t_D i f f_P ic  :=  Ver t_D i f f_P ic/Normal iz ing_Pictur e ; 
RETURN  (Abs  (Horiz_Diff  Pic))  +  (Abs  (Ver t_Dif f_Pic) ) ; 
END  Textur e_Edge_DetectIon ; 

FIGURE  A;  Ada-IPL  Texture  Edge  Detection. 


Finally,  instead  of  computing  the  gradient,  it  computes  an 
approximation  to  the  magnitude  of  the  derivative  by  summing 
the  absolute  values  of  the  row  and  column  differences. 

An  important  problem  for  this  algorithm  is  the  mapping 
of  Pat  values  into  other  domains.  This  algorithm  assumes 
that  the  Pat  domain  is  some  subset  of  the  Natural  integers 
(0  to  +infinity).  Then,  by  using  the  fact  that  the  Natural 
integers  are  closed  with  respect  to  addition,  it  follows 
that  by  integer-dividing  the  sum  by  the  number  of  elements 
in  the  summation,  an  integer  within  the  Pat  subrange  will 
result.  Thus  the  "average"  operation  is  closed  with  respect 
to  the  Pat  domain  but  must  be  computed  with  values  outside 
of  the  domain.  In  addition,  the  absolute  value  function  is 
redefined  to  return  an  object  of  type  Pat.  In  summary  then, 
V"  operates  over  Naturals,  Abs  operates  on  Naturals 
returning  Pats,  and  there  are  two  "+"  operations,  one 
operating  over  Pats  and  another  (within  the  linear 
combination)  operating  on  a  Pat  and  a  Natural  returning  a 
Natural.  Once  these  mappings  are  defined,  the  algorithm 
follows  directly  from  the  mathematical  model. 

Observe  that  when  using  IPL  to  express  such  an 
algorithm  as  the  texture  edge  detection,  the  bulk  of  the 
effort  is  to  map  the  Pats  domain  into  a  suitable  domain (s) 
for  the  desired  operations,  and  then  to  map  from  that 
domain(s)  back  into  the  Pat  domain.  Once  this  is 
accomplished,  it  is  fairly  easy  to  express  the  desired 
mathematical  relationships. 
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Template  Matching 

The  normal ized  cross  correlation  can  be  used  to  locate 
areas  of  a  picture  which  match  a  template  (Rosenfeld  and 
Kak,  1976,  p.  298,;  Pratt,  1978  d.  551).  The  method  is  not 
described  in  detail  here  but  in  general  is  accomplished  by 
cross  correlating  the  template  with  the  picture  and  then 
normalizing  this  result  by  dividing  by  the  square  of  the 
picture's  Pat  values  summed  over  the  template  area.  The 
algorithm  in  Figure  7,  p.  46,  performs  this  operation  for  a 
template  of  any  size.  The  algorithm  includes  a 
straightforward  use  of  the  Fly,  Binary,  and  Unary  picture 
operations.  Calculations  are  performed  in  the  floating 
point  domain  primarily  due  to  the  division  required  to 
normalize  the  cross  correlation.  There  are  usually  small 
differences  between  "exact  matches"  and  "near  misses" 
requiring  the  increased  accuracy  of  the  floating  point 
domain.  Although  the  output  of  this  operation  is  a  oicture, 
it  would  most  likely  be  next  operated  on  by  a  search 
operation  to  create  a  registration  between  the  template  and 
the  picture.  After  the  completion  of  this  registration,  the 
output  picture  would  most  likely  be  discarded. 

Linear  Filter 

The  template  matching  algorithm  above  restricted 
template  values  to  the  Pat  domain.  In  general,  however,  the 
exact  grey  levels  of  a  pattern  are  not  as  important  as  the 
shape  of  the  pattern.  Thus  it  is  desirable  to  cross 
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FUNCTION  Normal i zed_Cr os s_Cor  relate 

(P  :  Pictures; 

Template  :  Pat_Mask; 

Template_Center  :  Val  id_Coordinates) 
RETURN  Float_P ictur es  is 

FUNCTION  Pat_LC  is  NEW  L inear_Combi nat ion 

(Element  1  I  Element_2  =>  Pats, 
Mask_l  T  Mask_2  =>  Pat_Mask, 
Element_3  =  >  Float) ; 

--  Must  have  (Left,  Right  :  Pats)  RETURN  Float  defined 

FUNCTION  Pat_LC_fly  is  NEW  Fly 

(Mask_Index  =>  Mask_Index, 
Element_l  =>  Pats, 

Mask_l  =>  Pat_Mask, 

Element_2  =>  Pats, 

Mask_2  =>  Pat_Mask, 

Picture_2  =>  Pictures, 

Element_3  =>  Float, 

Picture_3  =>  Float_Pictur e , 

F  =  >  Pa  t_LC )  ; 

FUNCTION  "/"  is  NEW  P ictur e_Binary_Op 

(Element_l  I  Element_2  Element_3  =>  Float, 

Picture_l  |  Picture_2  Picture_3  =>  Float_Pictures , 
F  =>  ; 

FUNCTION  "**"  is  NEW  Picture_Unary_Op 

(Elemental  I  Element_3  =>  Pats, 

Picture_l  I  Picture_3  =>  Pictures, 

F  =>"*★")  ; 

Cor relation_of_Template_and_P , 

P_Squared  ;  Float_Pictures  (P 'RANGE (1),  P ' RANGE ( 2 ) ) ; 

Temp-:  Pictures  (P ' RANGE ( 1 ) ,  P ' RANGE ( 2 ) ) ; 

Template_of_ls  :  CONSTANT 

Pat_Mask  (Template ’RANGE ( 1) ,  Template 'RANGE ( 2) ) 
:=  (OTHERS  =>  (OTHERS  =>  1)); 

BEGIN 

Cor relat ion_of_Template_and_P  :  = 

Pat_LC_Fly  (P,  Template,  Template_Center ) ; 

Temp  : =  P**2; 

P_Squared  :=  Pat_LC_Fly 

(Temp,  Templ3te_of_ls ,  Template_Center ) ; 

RETURN  Cor r e la t ion_of_Templa te_and_P  /  P_Sauared; 

END  Normalized  Cross  Correlate; 


FIGURE  7:  Ada-IPL  Normalized  Cross  Correlation 
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correlate  derivatives  (magnitude  only)  of  the  template  with 
the  picture  (Rosenfeld  and  Kak,  1976,  p.  306).  The 
declarations  in  Figure  8  provide  the  capability  to  apply  a 
general  linear  filter  to  a  picture  by  cross  correlating  a 
template  of  floating  point  values  with  it.  The  template  may 
be  any  size.  The  operation  of  multiplying  a  Pat  and  a 
floating  point  value  to  yield  a  floating  point  value  must  be 
defined  for  these  declarations  to  be  useful. 


FUNCTION  Linear_Filter  is  NEW  Linear_Combination 

(Element_l  =>  Pats, 

Mask_l  =>  Pat_Mask, 

Element_2  |  Element_3  =>  Float, 
Mask_2  =>  Float_Mask); 

FUNCTION  Linear_Filter_f ly  is  NEW  Fly 

(Mask_Index  =>  Mask_Index, 
Element_l  =>  Float, 

Mask_l  =>  Float_Mask, 

Element_2  =>  Pats, 

Mask_2  =>  Pat_Mask, 

Picture_2  =>  Pictures, 

Element_3  =>  Float, 

Picture_3  =>  Float_Picture , 

F  =>  Linear  Filter); 


FIGURE  8:  Ada-IPL  Declarations  for  a  Linear  Filter. 


As  an  example  of  the  use  of  this  operation,  suppose  we 
wished  to  locate  thin  (one  Pat)  ,  vertical  lines  in  a 
picture.  A  filter  for  such  an  operation  is  the  digital 
Laplacian  of  an  ideal  thin  vertical  line  (Rosenfeld  and  Kak, 
1976,  p.  306) 

-1/2  1  -1/2 
-1/2  1  -1/2 
-1/2  1  -1/2. 
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This  filtering  can  be  performed  in  the  Ada-IPL  by 

Filtered_Pic  :=  Linear_Filter_Fly 

(Pr  (  (-0.5,  +1.0,  -0.5)  , 

(-0.5,  +1.0,  -0.5)  , 

(-0.5,  +1.0,  -0.5)),  (2,  2));. 

Nonlinear  Filter  for  a  Thin,  Vertical  Line 

Rosenfe  6  and  Kak  (1976,  p.  307)  point  out  that  the 
linear  filter  for  a  thin,  vertical  line  discussed  above  has 
undesirable  responses  to  step  edges  and  isolated  points. 
They  then  describe  a  nonlinear  filter  for  detecting  these 
lines  (1976  p.  309) .  Figure  9  displays  the  declarations 
required  for  this  filter.  An  application  of  this  function 
does  not  use  the  element  values  of  an  input  template  since 
it  is  tailored  for  a  thin,  vertical  line  only.  The  fly 
operation  does  require  a  3x3  mask,  however,  so  that  the 
proper  sized  Pat  mas*  will  be  supplied  to  the 
Nonlinear_Ver t_Line_Filter  function.  Thus  the  Fly  Ml 
parameter  is  provided  with  a  3x3  mask  with  "0"  elements. 

The  function  can  be  applied  to  a  picture,  P,  by 

New_p  :=  Nonlinear_VL_Filter_Fly 

(P,  (  (0,  0,  0)  , 

(0,  0,  0)  , 

(0,  0,  0) ) ,  (2,2) ) ; . 


FUNCTION  Nonl inear_Ver t_Line_Filter  (Ml  :  Pat_Mask; 

M2  :  Float_Mask) 

RETURN  Float  is 

FUNCTION  Linear_Filter  is  NEW  Linear_Combination 

(Element_l  =>  Pats, 

Mask_l  =>  Pat_Mask, 

Element_2  |  Element_3  =>  Float, 
Mask_2  =>  Float_Mask); 

I,  J  :  Mask_Index; 

BEGIN 

I  .=  Ml 'FIRST ( 1) ; 

J  :=  Ml ' FIRST ( 2 ) ; 


Ml  ( I - 1 ,  J) 

> 

Ml  ( 1-1 , 

J-l) 

AND 

Ml  ( I - 1 ,  J-l) 

> 

Ml  ( 1-1 , 

J+l) 

AND 

M1(I,  J) 

> 

M1(I,  J' 

-1) 

AND 

Ml  ( I ,  J-l) 

> 

Ml  (I,  J+l) 

AND 

Ml  ( 1  +  1 ,  J) 

> 

Ml (1+1, 

J-l) 

AND 

M1U  +  1,  J-l) 

> 

Ml (1+1, 

J  +  l) 

THEN 

RETURN  Linear 

Filter 

(Ml 

/ 

( (-0.5, 

+  1.0, 

-0.5)  , 

(-0.5, 

+  1.0, 

-0.5) , 

(-0.5, 

+  1.0, 

-0.5) ) 

ELSE 

RETURN  0 ; 

END  IF; 

END  Nonlinear  Filter; 


SUBTYPE  Float_Mask_3x3  is  Float_Mask  (1..3,  1..3); 

FUNCTION  Nonl inear_VL_Fi lter_F ly  is  NEW  Fly 

(Mask_Index  =>  Mask_Index, 
Element_l  =>  Float, 

Mask_l  =>  Float_Mask_3x3 , 
Element_2  =>  Pats, 

Mask_2  =>  Pat_Mask, 

Picture_2  =>  Pictures, 

Element_3  =>  Float, 

Picture_3  =>  Float_Picture , 

F  =>  Nonlinear  Vert  Line  Filter) 


FIGURE  9:  Ada-IPL  Declarations  for 
a  Nonlinear  Filter  of  a  Thin  Vertical  Line. 


FUNCTION  Sobel  (Ml  :  Float_Mask;  M2  :  Pat_Mask) 

RETURN  Float  is 

FUNCTION  is  NEW  P  ictur_B inary_Op 

{Element_l  Element_3  =>  Float,  Element_2  =>  Pats, 
Picture_l  Picture_3  =>  Float_Pictures , 

Picture_3  =>  Pictures) ; 

—  The  Function  (Left  :  Float;  Right  :  Pat) 

--  RETURN  Float  must  be  defined. 

I  :  Index; 

X,  Y  :  Float  :=  0; 

Temp_Mask  :  Float_Mask  (Ml ' RANGE ( 1 )  ,  M2 'RANGE ( 2)  ) ; 

BEGIN 

Temp_Mask  :=  Float_Pictures (Ml)  *  P ictur es  (M2 )  ; 

—  Masks  can  be  explicitly  converted  to  Picture  types 

FOR  I  IN  Temp_Mask' RANGE (1)  LOOP 

Y  : =  Y  +  Temp_Mask(I,  1)  -  Temp_Mask(I,  3); 

END  LOOP; 

FOR  I  IN  Temp_Mask 'RANGE ( 2)  LOOP 

X  :=  X  +  Temo_Mask(3,  I)  -  TemD_Mask(l,  I); 

END  LOOP; 

RETURN  SQRRT  (X**2  +  Y**2); 

END  Sobel; 

FUNCTION  Sobel_Fly  is  NEW  FLY 

(Mask_Index  =>  Mask_Index, 
Element_l  =>  Float, 

Mask_l  =  >  Float_Mask, 

Element_2  =>  Pats, 

Mask_2  =  >  Pat_Mask, 

Picture_2  =>  Pictures, 

Element_3  =>  Float, 

Picture_3  =>  Float_Pictur e , 

F  =>  Sobel) ; 

FIGURE  10:  Ada-IPL  Declarations  for  Sobel  Edge  Enhancement. 


Sobel  Edge  Enhancement 

The  Sobel  operator  is  a  nonlinear  edge  enhancement 
technique  using  a  3x3  mask  (Pratt,  1978,  d.  487).  Figure  10 
contains  the  implementation  of  this  operator  in  Ada-IPL.  As 
with  the  nonlinear  vertical  line  filter,  the  input  mask  to 
the  fly  operation  defines  the  size  of  the  mask  required  by 


the  Sobel  function.  However,  because  of  the  symmetry  for 
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the  coefficients  in  the  Sobel  operation  the  mask  elements 
can  be  used  to  pass  these  values  adding  another  degree  of 
variability  to  the  function.  An  example  of  the  use  of  this 
Sobel  edge  enhancement  is 

FIoat_Picture  :=  Sobel_Edge_Enhance 

(P,  ({1,  2,  1) 

(2,  0,  2) , 

(1,  2,  1)  )  ,  (2,  2)  )  ;  . 

Note  that  a  Picture_Binary_Operation  is  defined  for  this 
function  and  then  applied  to  the  masks.  Ada  provides  for 
explicit  conversions  between  different  array  types  when  they 
have  the  same  dimensionality,  index  types,  and  component 
types  (Ada  Programming  Language ,  1983,  p.  4-22). 

Region  Algorithms 


Expand 

The  expand  operation  is  commonly  used  to  expand  the 
region  uniformly  in  all  directions  towards  the  edge  of  the 
picture.  This  operation  is  referred  to  by  Rosenfeld  and  Kak 
as  propogation  (1975,  p.  362).  Pats  are  included  in  the  new 
region  if  they  are  in  the  original  region  or  if  they  are 
adjacent  to  a  Pat  in  the  original  region.  Those  Pats  in  the 
original  region  remain  in  the  expanded  region.  The  Ada-IPL 
implementation  of  expand  is  presented  in  Figure  11.  The 
adjacency  mask  function  in  the  expand  operation  is  designed 
to  return  True  if  the  two  input  masks  have  True  values  in 
any  identical  locations  and  False  otherwise.  Thus,  the  body 
of  the  algorithm  flies  the  appropriate  mask  over  the  picture 
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FUNCTION  Expand  (R  :  Reqion; 

A  :  Adjacencies; 

Num_Times  :  Integer  :=  1); 

RETURN  Region  is 

FUNCTION  Ad jacency_Mask  (Ml,  M2  :  Boolean_Mask ) 

RETURN  Boolean  is 


I  :  Index; 

Temp  ;  Boolean  :=  False; 

BEGIN 

FOR  I  in  Ml' RANGE (1)  LOO? 

Ml ( 1)  :=  (Ml (I)  AND  M2 (I))  OR  Ml(l); 

END  LOOP; 

FOR  I  IN  Ml' RANGE (2)  LOOP 
Temp  :=  Temp  OR  Ml(l,  I); 


END  LOOP; 

RETURN  Temp; 

END  Ad j acency_Mask ; 

FUNCTION  Ad j acency_Fly  is  NEW  Region_Fly 

(Mask_Index  =>  Mask_Index,  Element_l  =>  Boolean, 
Mask_l  =>  Boolean_Mask ,  F  =>  Ad jacency_Mask ) ; 

X  :  CONSTANT  Boolean  :=  True; 

0  :  CONSTANT  Boolean  :=  False; 

Dummy  :  Region  (R.Row_First,  R.Row_Last, 

R. Column  First,  R. Column  Last); 


BEGIN 


WHILE  Num_Times  /=  0  LOOP 
IF  Organization  =  Hex_Even 


THEN  Dummy 

;=  Ad jacency_Fly 

(R, 

(  (0, 

X, 

X)  , 

(X, 

X, 

X)  , 

(0, 

X, 

X) )  , 

ELSIF  Organi 

zation  =  Hex  Odd 

THEN  Dummy 

:=  Ad jacency_Fly 

(R, 

(  (X, 

X, 

0)  , 

(X, 

X, 

X)  , 

(X, 

X, 

0)  )  , 

ELSIF  A  =  c4 

THEN  Dummy 

;=  Ad  jacency_Fly 

(R, 

( (0, 

X, 

0)  , 

(X, 

X, 

X)  , 

(0, 

X, 

0)  )  , 

ELSIF  A  =  c8 

THEN  Dummy 

:=  Ad j acency_Fly 

(R, 

( (X, 

X, 

X)  , 

(X, 

X, 

X)  , 

(X, 

X, 

X) )  , 

ELSE  RAISE  Inconsistent_Ad jacency ; 
END  IF; 


(2,  2)); 


(2,  2)  )  ; 


(2,  2)  )  ; 


(2,  2)); 


Num_Times  ;=  Num_Times  -  1; 
END  LOOP; 

RETURN  Dummy; 

END  Expand; 


FIGURE  11;  Ada-IPL  Expand  Algorithm. 


'  »•  r 


for  the  given  adjacency  and  repeats  this  the  specified 
number  of  times.  Defining  "X"  as  True  and  ”0"  as  False 
simplifies  the  visualization  of  the  masks. 

Shrink 

Conceptually  the  shrink  operation  is  the  opposite  of 
the  expand  operation,  even  though  they  do  not  commute  or 
annihilate  each  other.  Still  Shrink  is  easily  defined  as 
expanding  the  complement  of  the  given  region  and  then  taking 
the  complement  of  this  result  (Rosenfeld  and  Kak,  1976, 
p.  362) .  Figure  12  is  the  algorithm  which  performs  this 
operation . 

FUNCTION  Shrink  (R  :  Region; 

A  ;  Adjacencies; 

Num_Times  :  integer  :=  1); 

RETURN  Region  is 

BEGIN 

RETURN  Complement  (Expand  (Complement ( R) ,  A,  Num_Times) ) ; 
END  Shrink; 

FIGURE  12:  Ada-IPL  Shrink  Algorithm. 

Area 

The  area  operation  presented  here  is  merely  the  number 
of  Pats  which  are  in  the  given  region.  It  is  shown  in 
Figure  13.  The  algorithm  demonstrates  how  the  "For  Each" 
control  structure  is  implemented  in  Ada  using  the 
Next_Member  function.  The  Next_Member  function  returns  the 
coordinates  of  Pats  in  the  region  in  some  unspecified  order. 
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In  order  for  the  function  to  know  where  in  the  "list  of 
members"  it  is  located,  it  is  given  a  "previous"  Pat’s 
coordinates.  If  it  is  given  null  coordinates  then  it 
returns  a  "first"  member.  After  a  "last”  member  it  returns 
the  null  coordinates.  The  order  of  the  members  in  the 
"list"  as  well  as  which  members  are  "first”  or  "last"  is 
undefined.  The  implementation  of  the  "For  Each"  structure 
using  this  Next_Member  function  is  straightforward. 

FUNCTION  Area  (R  :  Region)  RETURN  Integer  is 

Temp  :  Integer  :=  0; 

Point  :  Coordinates  :=  (Nullity  =>  Nil); 

BEGIN 

Point  :=  Next_Member  (Point,  R) ; 

WHILE  Point. Nullity  /=  Nil  LOOP 
Temp  :=  Temp  +  1; 

Point  :=  Next_Member  (Point,  R) ; 

END  LOOP; 

RETURN  Temp; 

END  Area; 

FIGURE  13:  Ada-IPL  Area  Algorithm. 

Although  it  would  be  much  clearer  to  express  this 
algorithm  using  a  "For  Each"  loop,  it  is  not  possible  to  add 
control  structures  to  existing  languages  without  modifying 
the  compiler  or  requiring  a  precompiler.  When  imbedding  IPL 
within  a  high  level  language  the  cost  of  precompiling  or 
modifying  the  compiler  is  generally  not  worth  this  increase 
in  clarity.  If  a  compiler  were  implemented  for  the  IPL 
language,  however,  it  would  certainly  be  desirable  to 
include  a  direct  implementation  of  a  "For  Each"  loop  rather 
than  rely  on  equivalent  constructs. 


CHAPTER  SIX 
CONCLUSION 

An  image  processing  language  (IPL)  is  developed  from  an 
examination  of  the  domains  and  operations  which  are  commonly 
used  to  express  image  processing  operations  in  a  strongly 
typed,  high-level  language.  The  motivation  behind  this 
approach  is  to  develop  a  language  which  is  portable  and 
readable.  The  domains,  operations,  and  a  control  structure 
are  described  for  the  language.  In  addition,  the  language 
is  implemented  in  Ada  and  several  image  processing 
algorithms  are  expressed  in  this  implementation. 

Summary 

This  description  of  IPL  assumes  the  existence  of  D-type 
control  structures  and  data  type  definition  capabilities. 

In  addition,  IPL  defines  picture,  mask,  region,  boundary, 
and  histogram  data  types.  The  domains  for  these  types  are 
described  in  terms  of  a  basic  element  called  Pat  (for 
picture  atom)  whose  domain  definition  is  undefined.  Thus, 
each  of  the  above  domains  is  available  for  any  Pat  domain. 
The  structures  for  objects  from  the  picture  and  mask  domains 
are  identical,  a  two-dimensional  array,  but  their  semantic 
uses  in  IPL  are  different.  In  general,  pictures  are  the 
results  of  IPL  operations  while  masks  help  define  the 
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operations.  The  structures  for  objects  from  the  region  and 
boundary  domains  are  not  specified.  Histogram  objects  are 
equivalent  to  one  dimensional  arrays  which  are  indexed  by 
either  the  Pat  domain  or  another  domain  into  which  the  Pat 
domain  is  mapped. 

Several  operations  are  defined  for  these  domains. 
Picture,  mask,  and  region  domains  have  three  basic 
operations;  unary,  binary,  and  fly.  Unary  and  binary 
operations  can  be  completed  without  reference  to  the  values 
of  neighboring  Pats  while  fly  operations  require  such 
information.  Rotate_90  is  also  defined  for  the  picture 
domain.  The  region  domain  has  the  set  operations  of  union, 
intersection,  and  division;  object  creation  operations; 
and  component  selection  operations.  The  boundary  domain  has 
the  creation,  selection,  and  set  operations  listed  for 
regions.  It  also  has  a  border  following  operation  for 
traversing  the  boundary.  One  object  can  be  registered  to 
another  object  in  IPL  by  defining  a  registration,  a 
functional  mapping  from  the  coordinates  domain  of  the  first 
object  to  the  coordinates  domain  of  the  second.  This 
mapping  can  be  described  with  a  Set_Of_Coordinate_Pairs  or 
as  some  rule.  The  set  operations  (union,  intersection,  and 
division) ,  a  creation  operation,  and  component  selection 
operations  are  available  for  Set_Of_Coor d inate_Pa i r s 
objects . 
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One  additional  control  structure,  "For  Each"  is  defined 
for  I  PL  to  provide  the  capability  to  clearly  express  the 
execution  of  a  sequence  of  operations  for  each  member  of  a 
set.  This  control  structure  is  not  implemented  directly  in 
the  Ada  implementation  of  IPL  but  is  implemented  indirectly 
through  a  D-type  loop  structure  and  a  "Next"  function.  The 
"Next"  function  provides  a  capability  to  step  through  all 
the  elements  which  are  members  of  a  set.  This  differs  from 
the  equivalent  D-type  structure  which  steps  through  all 
potential  members  of  the  set  and  conditions  execution  of  the 
sequence  of  operations  on  set  membership.  The  inclusion  of 
the  "For  Each"  construct  improves  the  readability  of  IPL 
code . 


Results 

The  IPL  operations  form  a  basic  set  of  operations  which 
can  be  used  to  express  common  image  processing  algorithms. 
This  satisfies  the  first  goal  for  the  IPL  development. 

The  Ada  implementaion  of  IPL  (Ada-IPL)  satisfies  the 
second  goal,  to  describe  an  implementation  in  an  existing, 
portable,  high-level  language.  Ada  was  chosen  for  this 
implementation  because  one  of  its  design  goals  was  to 
develop  a  portable  language.  Ada  is  also  a  high-level 
language  with  the  D-type  control  structures  and  data  type 
definiton  facilities  required  by  IPL.  In  addition,  Ada 
provides  the  capability  to  describe  generic  subprograms,  or 
templates,  which  allowed  IPL  to  be  implemented  without 
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specifying  a  Pat  domain.  This  generic  capability  was  also 
used  to  define  the  unary,  binary,  and  fly  operations. 

Ada  effectively  separates  the  actual  implementation  of 
operations  from  their  use.  Thus,  portions  of  this 
implementation  of  IPL  may  be  changed  without  affecting  the 
correctness  of  algor i thms  written  it.  This  satisfies  the 
fourth  goal  of  the  IPL  development. 

The  Ada-IPL  is  not  complete  nor  has  it  been  compiled  or 
tested.  Picture  input  and  output  operations  are  not  defined 
since  they  depend  on  the  environment  in  which  they  are  used. 
Also,  no  Ada  compiler  was  available  to  check  or  test  this 
implementation.  The  Ada-IPL  is  presented  primarily  as  a 
demonstration  of  an  implementation  of  IPL.  It  also  Drovides 
a  second  description  of  IPL  as  well  as  a  syntax  for 
expressing  algorithms  in  IPL. 

In  order  to  demonstrate  IPL’s  capability,  several 
common  image  processing  algorithms  are  expressed  in  Ada-IPL. 
The  picture  algorithms  are  thresholding,  Laplacian 
filtering,  dif ferentiation,  texture  edge  detection,  template 
matching  by  cress  correlation,  linear  and  nonlinear 
filtering,  and  Sobel  edge  enhancement.  The  region 
algorithms  demonstrated  are  expand  (propogate) ,  shrink,  and 
the  area  of  a  region.  These  algorithms  were  selected  based 
on  their  common  use.  Thus,  thev  should  be  familiar  to  most 
readers.  In  addition,  the  algorithms  demonstrate  the  use  of 
the  IPL  unary,  binary,  and  fly  operations  and  they  highlight 
the  effect  IPL  has  on  their  expression. 
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Further  Work 

Several  areas  of  further  work  on  IPL  are  indicated. 
Obviously,  compiling  and  testing  the  Ada-IPL  is  necessary 
before  it  can  be  used  as  a  programming  language.  Until  this 
is  accomplished,  it  is  only  useful  as  a  design  or 
specification  language.  Concurrent  with  this  testing,  the 
implementation  of  the  operations  should  be  modified  to 
improve  their  performance.  The  implementations  provided 
were  used  based  on  the  ease  of  establishing  their 
correctness  and  communicating  the  semantics  of  the 
operations.  In  a  testing  environment,  these  operations 
should  be  implemented  with  increased  performance  where 
poss ible . 

Additional  work  is  also  needed  to  examine  other  image 
processing  algorithms  to  determine  if  any  additional 
operations  are  required  to  describe  them.  The  given 
operations  appear  to  be  adequate  to  express  any  image 
processing  task,  but  their  completeness  is  not  proven. 
Further  efforts  to  find  additional  operations  or  demonstrate 
the  completeness  of  the  given  operations  is  required. 

Finally,  an  architecture  could  e  designed  to  directly 
implement  the  unary,  binary,  and  fly  operations.  The  fly 
operation  appears  to  be  the  most  time  intensive  of  all  the 
IPL  operations.  By  focusing  an  architecture  on  improving 
the  performance  of  the  fly  as  well  as  the  unary  and  binary 
operations,  a  very  efficient  architecture  for  image 
processing  can  be  ceveloped.  The  nature  of  these  three 
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operations  suggest  an  architecture  similar  to  that  described 
for  the  CLIP4  (Duff,  1979),  but  since  the  development  of 
this  language  was  purposefully  divorced  from  architectural 
considerations,  the  subject  of  an  architecture  for  the 
language  requires  much  closer  examination. 


'  •>  t 


1 


REFERENCES 


Ada  Programming  Language ,  ANSI/MIL-STD-1815A,  22 
January  1983,  Naval  Publications  and  Forms  Center, 
Phildelphia,  Pa.  (1983). 

Bulman,  David  M.,  "Is  Ada  the  Answer?"  The  Yourdon 
Repor  t ,  vol.  6-6,  7-1,  Yourdon  Inc.,  New  York 
(1981)  . 

Chang,  Nina-San,  Image  Analysis  and  Image  Data  Base 
Management,  UMI  Research  Press,  Ann  Arbor,  Michigan 
(1981)  . 

Douglas,  R.  J.,  "MAC:  A  Programming  Language  for 
Asynchronous  Image  Processing,"  in  Languages  and 
Architectures  for  Image  Processing ,  Duff  M.  J.  3., 
and  Levialdi,  S.  (ed,),  Harcourt  Brace  Jovanovich, 
Publishers,  New  York,  op.  41-52  (1981). 

Duff,  M.  J.  B.,  "Parallel  Processors  for  Digital 
Image  Processing,"  in  Advances  in  Digital  Image 
Processing ,  Stucki,  P.  (ed.),  Plenum  Publishing 
Corp. ,  New  York,  dd.  265-276  (1979). 

Duff,  M.  J.  B.,  and  Levialdi,  S.,  Languages  and 
Architectures  for  Image  Processing ,  Harcourt  Brace 
Jovanovich,  Publishers,  New  York  (1981). 

Foley,  James  D. ,  and  Van  Dam,  Andries,  Fundamentals 
of  Interactive  Computer  Graphics ,  Addison-Wesley 
Publishing  Company,  Inc.,  Reading,  Massachusetts 
(1983)  . 

Gudmundsson,  B.,  "Overview  of  the  High-level 
Language  for  PICAP,"  in  Languages  and  Architectures 
for  Image  Processing ,  Duff,  M.  J.  B.,  and  Levialdi, 
S.  (ed.),  Harcourt  Brace  Jovanovich,  Publishers, 

New  York,  pp.  147-156  (1931). 


Kulpa ,  Z.,  "PICASSO,  PICASSO-SHOW ,  and  PAL  —  A 
Development  of  a  Hiqh-level  Software  System  for 
Image  Processing,"  in  Languages  and  Architectures 
for  Image  Processing ,  Duff,  M.  J.  B.,  and  Levialdi, 
S.  (ed.),  Harcourt  Brace  Jovanovich,  Publishers, 

New  York,  pp.  13-24  (1981). 

Ledgard,  Henry  and  Marcotty,  Michael,  The 
Programming  Language  Landscape ,  Science  Research 
Associates,  Inc.,  Chicago,  Ill.  (1981). 

Levialdi,  S.,  Maggiolo-Schettini ,  A.,  Napoli,  M., 
Tortora,  G.,  and  Uccella,  G.,  "On  the  Design  and 
Implementation  of  PIXAL,  a  Language  for  Image 
Processing,"  in  Languages  and  Architectures  for 
Image  Processing ,  Duff,  M.  J.  B.,  and  Levialdi,  S., 
(ed.),  Harcourt  Brace  Jovanovich,  Publishers,  New 
York,  pp.  89-98  (1991) . 

Maggiolo-Schettini,  A.,  "Comparing  Some  High-level 
Languages  for  Image  Processing,"  in  Languages  and 
Arch i tectur es  for  Image  Processing ,  Duff,  M.  J.  B., 
and  Levialdi,  S.  (ed.),  Harcourt  Brace  Jovanovich, 
Publishers,  New  York,  pp.  157-164  (1981). 

Pratt,  William  K.,  Dig  i  tal  Image  Processing ,  John 
Wiley  and  Sons,  Inc.,  New  York  (1973). 

Radha.kr  ishnan ,  T.  ,  Barrera,  R.  ,  Guzman,  A.,  and 
Jinich,  A.,  "Design  of  a  High-level  Language  (L) 
for  Image  Processing  in  Languages  and  Architectures 
for  Image  Processing ,  Duff,  M.  J.  B.,  and  Levialdi, 
S.  (ed.),  Harcourt  Brace  Jovanovich,  Publishers, 

New  York,  pp.  25-40  (1981). 

Rosenfeld,  Azriel  and  Kak,  Avinash  C.,  Digital 
Picture  Processing ,  Harcourt  3race  Jovanovich, 
Publishers,  New  York  (1976). 

Sinha,  R.  M.  K.,  "PLANG  --  A  Picture  Language 
Schema  for  a  Class  of  Pictures,"  Pattern 
Recognition,  vol.  16,  no.  4,  pp.  373-333  (1983). 

Williams,  Robin,  "Image  Processing  and  Computer 
Graphics,”  in  Advances  in  Digi tal  Image  Processing , 
Stucki,  P.  (ed.).  Plenum  Publishing  Corp. ,  New 
York,  pp.  219-234  (1979) . 


APPENDIX  A 

ADA  IMPLEMENTATION  OF  I  PL 


GENERIC 

TYPE  Pats  is  PRIVATE; 

Organization  :  IN  {Orthogonal,  Hex_even,  Hex_odd) 

:=  Orthogonal; 

Mask_Index_First  :  IN  Integer  :=  1; 

PACKAGE  IPL  is 

TYPE  Index  is  Integer; 

TYPE  Pictures  is 

ARRAY  (Index  RANGE  <>,  Index  RANGE  <>)  OF  Pats; 
Incompatible_Pictures  :  EXCEPTION; 

— Picture  Ooerations 
GENERIC 

TYPE  Element_l  is  PRIVATE; 

TYPE  Pictur e_l  is  ARRAY 

(Index  RANGE  <>,  Index  RANGE  <>)  OF  Element_l; 
TYPE  Element_2  is  PRIVATE; 

TYPE  Picture_2  is  ARRAY 

(Index  RANGE  <>,  Index  RANGE  <>)  OF  Element  2; 
TYPE  Element_3  is  PRIVATE; 

TYPE  P ictur e_3  is  ARRAY 

(Index  RANGE  <>,  Index  RANGE  <>)  OF  Element_3; 
WITH  F(Left  ;  Element_l;  Right  :  Element_2) 

RETURN  Element_3  is  <>; 

FUNCTION  P ictur e_B inary_Op 

(Left  :  Picture_l;  Right  :  Picture_2) 
RETURN  Picture_3 ; 

—  Left  and  Right  must  be  of  the  same  size 
—  i.e.  Left' LENGTH  =  Right' LENGTH 
—  Incompatible  Pictures  is  raised  if  they  are  not 
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GENERIC 

TYPE  ELement_l  is  PRIVATE; 

TYPE  Picture_l  is  ARRAY 

(Index  RANGE  <>,  Index  RANGE  <>)  OF  Elemental; 
TYPE  Element_3  is  PRIVATE; 

TYPE  Picture_3  is  ARRAY 

(Index  RANGE  <>,  Index  RANGE  <>)  OF  EIement_3; 
WITH  F (Lef t  :  Elemental)  RETURN  Element_3  is  <>; 
FUNCTION  Picture_Unary_Op  (Left  :  Picture_I) 

RETURN  Picture_3; 

FUNCTION  Rotate_90  (P  ;  Pictures;  Times  :  Natural) 

RETURN  Pictures; 

PROCEDURE  Input_Picture  (P  :  OUT  Pictures) ; 

PROCEDURE  Output_Picture  (P  :  IN  Pictures) ; 

TYPE  Nullities  is  (Nil,  Valid); 

TYPE  Coordinates  is  RECORD  (Nullity  :  Nullities  :=  Nil; 

Row_First  :  Index; 

Row_Last  :  Index; 
Column_First  :  Index; 
Column_Last  :  Index) 

CASE  Nullity  is 
WHEN  Nil  =»>  NULL; 

WHEN  Valid  => 

Row  :  Index  RANGE  Row_First. .Row_last; 

Column  :  Index  RANGE  Column_First . .Column_Last; 
END  RECORD; 

SUBTYPE  Valid_Coordinates  is 

Coordinates  (Nullity  =>  Valid); 

TYPE  Histograms  is  ARRAY  (Pats  RANGE  ^>)  of  Natural; 
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-  Mask  Operations 
SUBTYPE  Mask_Index  is 

Index  RANGE  Mask_Index_First. .Max_Int; 
TYPE  Pat_Mask  is  ARRAY 

(Mask_Index  RANGE  <>,  Mask_Index  RANGE  <>)  OF  Pats; 
Mask  objects  can  be  explicitly  converted  to  type  Picture 

GENERIC 

TYPE  Mask_Index  is  RANGE  <>;  --  Integer  Type 

TYPE  Element_l  is  PRIVATE; 

TYPE  Mask_l  is  ARRAY 

(Mask_Index  RANGE  <>,  Mask_index  RANGE  <>) 

OF  Element_l; 

TYPE  Element_2  is  PRIVATE; 

TYPE  Mask_2  is  ARRAY 

(Mask_Index  RANGE  <>,  Mask_index  RANGE  <>) 

OF  Element_2; 

TYPE  Picture_2  is  ARRAY 

(Index  RANGE  <>,  Index  RANGE  <>)  of  Element_2; 
TYPE  Element_3  is  PRIVATE; 

TYPE  Picture_3  is  ARRAY 

(Index  RANGE  <>,  Index  RANGE  <>)  of  Element_3; 
WITH  FUNCTION  Border_Value  (I,  J  :  Index) 

RETURN  Pats  is  Zero_Border; 

WITH  F  (Ml  :  Mask_l;  M2  :  Mask_2) 

RETURN  Element_3  is  <>; 

—  F  is  called  by  Fly  only  with  masks  of  the  same  size 
--  i.  e.,  Ml ' Length ( 1)  =  M2'Length(l) 

AND  Ml ' Length ( 2)  =  M2’Length(2) 

FUNCTION  Fly  (P2  :  Picture_2; 

Ml  :  Mask_l; 

Mask_Center  :  Val id_Coordinates) 

RETURN  Picture_3 ; 

—  P2  and  P3  must  be  the  same  size 
—  i.e.  P2' LENGTH  =  P3 ' LENGTH 

--  Incompatible_Pictures  is  raised  if  they  are  not 
GENERIC 

TYPE  Element_l  is  PRIVATE; 

TYPE  Mask_l  is  ARRAY 

(Mask_Index  RANGE  <>,  Mask_index  RANGE  <>) 

OF  Element_l; 

TYPE  Element_2  is  PRIVATE; 

TYPE  Mask_2  is  ARRAY 

(Mask_Index  RANGE  <>,  Mask_index  RANGE  <>) 

OF  £lement_2; 

TYPE  Element_3  is  PRIVATE; 

WITH  (El  :  Element_l ;  E2  :  Element_2) 

RETURN  Element_3)  is  <>; 

FUNCTION  L inear_Combinat ion  (Ml  :  Mask_l;  M2  :  Mask_2) 
RETURN  Element_3 ; 

—  Ml  and  M2  must  be  of  the  same  size 
--  or  Constraint  error  is  raised 
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TYPE  Adjacencies  is  (C 4 ,  C8,  C6); 

FUNCTION  Adjacent  (Cl,  C2  :  Val id_Coordinates; 

A  :  Adjacencies)  RETURN  Boolean; 
Incons istent_Ad jacencies  :  EXCEPTION; 

Region  Operations 
TYPE  Region  (Row_First  :  Index; 

Row_Last  :  Index; 

Column_First  ;  Index; 

Column_Last  :  Index)  is  PRIVATE; 

FUNCTION  Pat_Value  (R  :  Region;  C  :  Val id_Coor dinates ) 
RETURN  Pats; 

FUNCTION  Make_Pat_Reg ion 

(P  :  Pictures;  C  :  Val id_Coordinates)  RETURN  Region; 
TYPE  Boolean_Pictures  is  ARRAY 

(Index  RANGE  <>,  Index  RANGE  <>)  OF  Boolean; 
FUNCTION  Make_Region 

(P  :  Pictures;  BP  :  Boolean_Pictures)  RETURN  Region; 
FUNCTION  In_Region  (R  :  Region;  C  :  Valid_Coordinates) 
RETURN  3oolean ; 

FUNCTION  "+"  (Rl,  R2  :  Region)  RETURN  Region; 

--  Union 

FUNCTION  ,,*M  (Rl,  R2  :  Region)  RETURN  Region; 

--  Intersection 

FUNCTION  (Rl,  R2  :  Region)  RETURN  Region; 

—  Difference 

FUNCTION  Complement  (R  :  Region)  RETURN  Region; 

FUNCTION  Picture_Of  (R  :  Region)  RETURN  Pictures; 
FUNCTION  Next_Member  (C  :  Coordinates;  R  :  Region) 

RETURN  Coordinates; 

—  C  must  be  in  R  or  the  Null  Coordinates 
Incompatible_Regions  :  EXCEPTION; 

— Region  3inary  ODeration 
GENERIC 

TYPE  Element_2  is  PRIVATE; 

TYPE  P ictur e_2  is  ARRAY 

(Index  RANGE  <>,  Index  RANGE  <>)  OF  Element_2; 
WITH  F(Left  :  Boolean;  Right  :  Element_2) 

RETURN  Boolean  is  <>; 

FUNCTION  Region_Binary_Op 

(Left  :  Region;  Right  ;  Picture_2)  RETURN  Region; 
--  Left  and  Right  must  be  of  the  same  size 
--  i.e.  Left. Last  -  Left. First  =  Right'LENGTH 
--  Incompatible_Regions  will  be  raised  if  they  are  not 

--  Region  Mask  Operations 
TYPE  Boolean_Mask  is  ARRAY 

(Mask_Index  RANGE  <>,  Mask_Index  RANGE  <>) 
of  Boolean; 
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GENERIC 

TYPE  Mask_Index  is  RANGE  <>;  --  Integer  Type 

TYPE  Element_l  is  PRIVATE; 

TYPE  Mask_l  is  ARRAY 

(Mask_Index  RANGE  <>,  Mask_index  RANGE  <>) 

OF  Element_l; 

WITH  FUNCTION  3order_Value  (I,  J  :  Index) 

RETURN  3oolean  is  Not_In_Border ; 

WITH  F  (Ml  :  Mask_l;  M2  :  3oolean_Mask ) 

RETURN  Boolean  is  <>; 

—  F  is  called  by  Fly  only  with  masks  of  the  same  size 

—  i.e.  Ml'Length(l)  =  M2'Length(l) 

—  AND  Ml' Length (2)  =  M2' Length (2) 

FUNCTION  Region_Fly  (R  :  Region; 

Ml  :  Mask_l; 

Mask_Center  :  Val id_Coordinates ) 

RETURN  Region; 


-Boundary  Opera 
TYPE  Boundar 


TYPE  Boundar 
FUNCTION  Pat 
RETURN 
FUNCTION  In_ 
RETURN 
FUNCTION  Mak 
RETURN 

FUNCTION  On_ 
RETURN 

TYPE  Directi 
FUNCTION  Nex 


t  ions 

y  (Row_First  :  Index; 

Row_Last  ;  Index; 

Column_First  :  Index; 

Column_Last  ;  Index)  is  PRIVATE; 
y  Classifications  is  (On,  Off,  Limit); 


_Value  (B  ; 
Pats; 

Region  (B  ; 

Boolean; 
e_Boundary 
Boundary; 
Boundary  (3 
C 


Boundary; 

Boundary; 


Region; 


Val id_Coordi nates) 
Val id_Coordi nates ) 
:  Adjacency) 


Boundary; 

Valid  Coordinates) 


RETURN 

FUNCTION  Reg 
Incompatible 


Bound a ry_C lass i f icat ion; 
on  is  (Clockwise,  Counterclockwise); 
t_Pat  (B  :  Boundary; 

A  :  Adjacency; 

D  ;  Direction; 

C_On ,  C_previous  :  Coordinates) 
Coordinates; 

ion_Of  (B  :  Boundary)  RETURN  Region; 
Coordinates  ;  EXCEPTION; 
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Registration 

GENERIC 

From_Picture  :  IN  Pictures; 

To_Picture  :  IN  Pictures; 

PACKAGE  Coord inate_Pa i r_Sets  is 

TYPE  Coordinate_Pair_Set  is  PRIVATE; 

TYPE  From_Coord inates  is  Val id_Coordinates 

(Row_First  =>  From_Picture ' FIRST ( 1) , 
Row_Last  =>  From_P ictur e 1  LAST ( 1)  , 
Column_First  =>  From_Picture' FIRST ( 2) , 
Column_Last  =>  Frora_P ictur e ’ LAST ( 2) ) ; 

TYPE  To_Coordinates  is  Coordinates 

(Row_First  =>  To_Picture' FIRST ( 1) , 

Row_Last  =>  To_Picture ' LAST ( 1) , 
Column_First  =>  To_Picture' FIRST ( 2) , 
Column_Last  =>  To_Picture ' LAST ( 2) ) ; 

TYPE  Coord inate_Pa i rs  is 

RECORD  (Nullity  ;  Nullities  :=  Nil) 

CASE  Nullity  is 
WHEN  Nil  =>  NULL; 

WHEN  Valid  => 

From  :  From_Coordinates ; 

To  :  To_Coord inates; 

END  Record; 

SUBTYPE  Valid_Coordinate_Pairs  is 

Coordinate_Pairs  (Nullity  =>  Valid); 

Nul  1__CPS  :  CONSTANT  Coo7dinate_Pair_Set; 
Inconsistent_CPS  :  EXCEPTION; 

This  implementation  does  not  use  this  error. 

Its  occurance  is  prevented  by  the  package  parameters 
restricting  calls  to  these  functions  with  CPSs  from 
the  input  pictures  only  (From  and  To) 

Inconsistent_Registration  :  EXCEPTION; 

FUNCTION  "+"  (Set_l ,  Set_2  :  Coordinate_Pair_Set) 
RETURN  Coordinate_Pair_Set;  —  UNION 
FUNCTION  (Set_l ,  Set_2  :  Coordinate_Pair_Set) 

RETURN  Coordinate_Pa ir_Set;  —  INTERSECTION 
FUNCTION  (Set_l ,  Set_2  :  Coordinate_Pair_Set) 

RETURN  Coord inate_Pair_Set;  —  DIFFERENCE 
FUNCTION  Convert_To_Set  (CP  ;  Valid_Coordinate_Pairs) 
RETURN  Coordinate_Pair_Set; 

FUNCTION  Next_Element  (CP  :  Coordinate_Pairs; 

Set  ;  Coordinate_Pair_Set) 
RETURN  Coordinate_Pairs; 

—  CP  must  be  in  Set  or  the  Null_Registerd_Coordinates 
FUNCTION  Registered_Coordinates 

(Cl  :  From_Coordinates;  Set  :  Coordinate_Pair_Set) 
RETURN  To_Coord inates ; 

FUNCTION  Change_Reg is  ter ed_Coord inates 

(CP  :  Val id_Coor d inate_Pa i r s ; 

Set  :  Coordinate_Pair_Set) 

RETURN  Coordinate  Pair  Set; 
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GENERIC 

WITH  FUNCTION  Map  (From_pt:  From_Coord inates ; 

Enumer ated_Map:  Coord inate_Pa i r_Set) 
RETURN  To_Coordinates  is  <>; 

From  Picture:  IN  Pictures; 

To_PTcture:  IN  Pictures; 

Registered_Map  :  Coordinate_Pair_Set; 

PACKAGE  Register  is 

No_Register ed_Value  :  EXCEPTION; 

FUNCTION  Registered_Coordinates 

{From_Point:  From_Coordinates) 
RETURN  To_Coordinates ; 

FUNCTION  Registered_Value 

(From_Point:  From_Coordinates)  RETURN  Pats; 
END  Register; 

PRIVATE 

TYPE  Coordinate_Pair  Set  is  ARRAY 

(From_Picture 'RANGE ( 1) ,  From_Picture' RANGE ( 2) ) 
OF  To_Cocrdinates ; 

Null_CPS  :  CONSTANT  Coordinate_Pair_Set 

:=  (OTHERS  =>  (Nullity  =>  Nil)); 

END  Coordinate  Pair  Sets; 


PRIVATE 

TYPE  Region  is  RECORD  (Row_First  :  Index; 

Row_Last  :  Index; 

Column_First  :  Index; 
Column_Last  :  Index) 

Base_Picture  :  Pictures  (Row_First. .Row_Last, 

Column_First. .Column_Last) ; 
Reg ion_Member s  :  ARRAY 

(Index  RANGE  Row_F i r s t . . Row_Las t , 
Index  RANGE  Column_F i r s t . .Column_Las t ) 
of  Boolean; 

END  Record 

TYPE  Boundary  is  RECORD  (Row_First  :  Index; 

Row_Last  :  Index; 
Column_First  :  Index; 
Column_Last  :  Index) 

Base_Region  :  Region  (Row_First,  Row_Last, 
Column_First,  Column_Last) ; 
Boundary_Members  :  ARRAY 

(Index  RANGE  Row_First. .Row_Last, 

Index  RANGE  Column_First. .Column_Last) 
of  Boundary_Classif ications 
:=  (OTHERS  =>  Off) ; 

Boundary_Ad j acency  :  Adjacency; 

END  Record; 


END  I  PL- 
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APPENDIX  B 

BODY  FOR  THE  ADA  IMPLEMENTATION  OF  IPL 


PACKAGE  BODY  IPL  is 

FUNCTION  P ictur e_3 inary_Op  (Left  :  Picture_l; 

Right  :  Picture_2) 

RETURN  Picture_3  is 
I,  J  :  Index; 

Dummy  ;  Pictures  (Lef t 1  RANGE ( 1)  ,  Left’ RANGE ( 2) ) ; 
BEGIN 

IF  NOT  ( (Left'Range (1)  =  Right ' Range ( 1 )  ) 

OR  (Lef t’ RANGE (2)  =  Right ' RANGE ( 2 )) ) 

THEN  RAISE  Incompa t i ble_P ictur es ; 

ENDIF; 

FOR  I  in  Lef t' RANGE (1)  LOOP 
FOR  J  in  Right' RANGE (2)  LOOP 

Dummv  (I,  J)  :=  F  (Left (I,  J)  ,  Right (I,  J) ) ; 
END  LOOP; 

END  LOOP 
RETURN  Dummy; 

END  P icture_Binary_Op; 

FUNCTION  Rotate_90  (P  :  Pictures;  Times  :  Positive) 
RETURN  Pictures  is 
I,  J,  N  :  Index; 

Dummy  :  Pictures  (P ' RANGE ( 1 ) ,  P ' RANGE ( 2 ) ) ; 

BEGIN 

WHILE  Times  /=  0  LOOP 
N  :=  Dummy' LAST ( 2) ; 

FOR  I  in  P' RANGE (1)  LOOP 
FOR  J  in  P' RANGE (2)  LOOP 
Dummy  (J,  N)  :=  P  (I,  J); 

END  LOOP; 

N  :=  Index'PRED(N) ; 

END  LOOP; 

Times  :=  Times  -  1; 

END  LOOP; 

RETURN  Dummy; 

END  Rotate  180; 
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FUNCTION  Picture_Unary_Op  (Left  :  Pictute_l) 

RETURN  Picture_3  is 
I,  J  :  Index; 

Dummy  ;  Pictures (Left1 RANGE ( 1) ,  Left' RANGE ( 2) ) ; 
3EGIN 

FOR  I  in  Left' RANGE ( 1)  LOO? 

FOR  J  in  Right' RANGE (2)  LOOP 

Dummy  (I,  J)  :=  F  (Left  (I,  J) )  ; 

END  LOOP; 

END  LOOP 
RETURN  Dummy; 

END  P ictur e_Unar y_Op; 

FUNCTION  Adjacent  (Cl,  C2  :  Val id_Coordinates) 

RETURN  Boolean  is 
Adj  ;  Boolean; 

BEGIN 

IF  ( ( (A  =  C6)  AND  (Organization  =  Orthogonal)) 

OR  ((A  /=  C6)  AND  (Organization  /=  Orthogonal))) 
THEN  RAISE  Ad j acency_Er ror ; 

ENDIF ; 

Adj  :=  ( ( ( (Abs  (Cl. row  -  C2.row))  =  1) 

AND  (Cl. Column  =  C2. Column)) 

OR  (((Abs  (Cl. Column  -  C2. Column))  =  1) 

AND  (Cl. Row  =  C  2 . Row)  ) )  ; 

IF  NOT  Adj 

THEN  IF  A  *  .8 

THEN  Adj  :=  (((Abs  (Cl. Row  -  C2.Row))  =  1) 

AND  ((Abs  (Cl. Column  -  C2. Column))  =  1)); 
ELSEIF  ( (A  =  C6 ) 

AND  ((Abs  (Cl. Row  -  C2.Row))  =  1) 

THEN  IF  C2. Column  -  Cl. Column  =  1 

THEN  Adj  :=  (((Organization  =  Hex_Even) 
AND  ((Rem  (Cl. Row,  2))  =  1)) 

OR  ( (Organization  =  Hex_Odd) 
AND  ((Rem  (Cl. Row,  2))  =  0))); 
ELSEIF  Cl. Column  -  C2. Column  =  1 
THEN  Adj  :=  (((Organization  =  Hex_Even) 
AND  (Rem  (Cl. Row,  2) )  =  0) ) 

OR  (  (Organization  =  Hex_Odd) 
AND  ((Rem  (Cl. Row,  2))  =  1))); 

ENDIF; 

ENDIF; 

ENDIF; 

RETURN  Adj; 

END  Adjacent; 

FUNCTION  Zero_3order  (I,  J:  Index;  P;  Pictures) 

RETURN  Pats  is 

BEGIN 

RETURN  0; 

END  Zero  Border; 
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FUNCTION  Fly  (P2  :  Picture_2; 

Ml  :  Mask_l; 

Mask_center  :  IN  Val id_Coordinates ) 
RETURN  Pictures  is 

Dummy  :  Pictures  ( P2 ' RANGE ( 1 ) ,  P2 ' RANGE ( 2) ) ; 

M2  :  Mask_2  (Ml 1  RANGE ( 1)  ,  Ml ’ RANGE ( 2) ) ; 

I,  J,  I_Offset,  J_Offset,  K,  N  :  Index; 

Hex_Cor rect ion  :  Index  RANGE  1..0; 

BEGIN 

FOR  I  IN  P2' RANGE (1)  LOOP 
FOR  J  IN  P 2' RANGE (2)  LOOP 

IF  (Organization  /=  Orthogonal) 

AND  THEN  ((Rem  (Mask_Center . Row ,  2)) 

=  (Rem  (I,  2))) 

THEN  Hex_Cor rect ion  :=  0; 

ELSE  Hex_Cor rect ion  :=  1; 

ENDIF ; 

FOR  K  IN  M2' RANGE (1)  LOOP 
FOR  N  IN  M2 'RANGE (2)  LOOP 

I_Cffset  :  =  I  +  Mask_Center . Row  -  K; 
J_Offset  : =  J  +  Mask_Center .Column  -  N 
+  Hex_Correction; 

IF  (I_Offset  IN  P2 ' RANGE ( 1) ) 

AND  ( J_Of  f set  IN  P2' RANGE (2)) 

THEN  M2 ( K , N )  :=  P2(I_Offset,  J_0£fset); 
ELSE  M2 (K ,N)  := 

Borde revalue ( I_Of f set ,  J_Of f  set  l ; 

ENDIF; 

END  LOOP; 

END  LOOP; 

Dummy { I , J)  :=  F(M1,  M2) ; 

END  LOOP; 

END  LOOP; 

RETURN  Dummv; 

END  Fly; 

FUNCTION  Linear_Combination  (Ml  :  Mask_l;  M2  :  Mask_2) 
RETURN  Element_3  is 
--  Ml  and  M2  must  be  of  the  same  size 
--  or  Constraint_Er ror  is  raised 
IM1 ,  JM1,  IM2,  JM2  :  Index; 

TEMP  ;  £lement_3  ;=  0; 

BEGIN 

IM1  ;=  Ml ' FIRST ( 1 ) ;  JM1  :=  M1'FIRST(2); 

FOR  IM2  in  M2' RANGE (1)  LOOP 
FOR  JM2  in  M2 'RANGE,  2)  LOOP 

Temp  :=  Temp  +  (Ml ( IM1 ,  JM1)  *  M2(IM2,  JM2 ) ) ; 
IM1  :=  Index ' SUCC ( IM1)  ; 

END  LOOP; 

JM1  :=  Index ' SUCC (JM1 ) ; 

END  LOOP; 

RETURN  Temp; 

END  Linear  Combination; 
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PACKAGE  BODY  Coordinate  Pair  Sets  is 

FUNCTION  "+"  (Set_I,  Set_2  :  Coor d ina te_Pa i r_Se t ) 
RETURN  Coordinate_Pair_Set  is  --  UNION 
I,  J  :  Index; 

Dummy  .  Coordinate  Pair  Set 

(Set“l ’ RANGE ( 1) ,  Set_2 ’ RANGE ( 2) ) 

:=  (OTHERS  =>  (Nullity  =>  Nil}); 

BEGIN 

FOR  I  IN  Set_l ' RANGE ( 1)  LOOP 
FOR  J  IN  Set_l ' RANGE ( 2)  LOOP 

IF  Set_l ( I ,  J)  /=  (Nullity  =>  Nil) 

THEN  IF  Set_2  ( I  ,  J)  =  '(Nullitv  =>  Nil) 

OR  Set_l ( I ,  J)  =  Set_2 ( I ,  J) 

THEN  Dummy (I,  J)  :=  Set_l(I,  J); 

ELSE  RAISE  I  neons i s ten t_Reg i s t r at  ion ; 
ENDIF ; 

ELSE  Dummy (I,  J)  :=  Set_2(I,  J); 

ENDIF; 

ENDLOOP; 

ENDLOOP; 

RETURN  Dummy; 

END  "+"; 

FUNCTION  "*"  (Set_l,  Set_2  :  Coordinate_Pair_Set) 

RETURN  Coord xnate_Pai r_Set  is  —  INTERSECTION 
I,  J  :  Index; 

Dummy  :  Coord ina te_Pa i r_Set 

(Set_l ’ RANGE ( 1) ,  Set_2 ' RANGE ( 2) ) 

:=  (OTHERS  =>  (Nullitv  =>  Nil)); 

BEGIN 

FOR  I  IN  Set_l ’ RANGE ( 1)  LOOP 
FOR  J  IN  Set_2 ' RANGE ( 2)  LOOP 

IF  Set_l ( I ,  J)  /=  (Nullitv  =>  Nil) 

THEN  IF  Set_l  ( I ,  J)  =  Set_2 ( I ,  J) 

THEN  Dummy (I,  J)  :=  Set_l(I,  j); 

ELSE IF  Set_2 ( I ,  J)  /=  (Nullity  =>  Nil) 
THEN  RAISE  I  neon s i s ten t_Reo i s t r a t ion ; 
ENDIF; 

ENDIF; 

ENDLOOP; 

ENDLOOP; 

RETURN  Dummy; 

END 


FUNCTION  Conve r t_To_Set  (CP  :  Val id_Coordinate  Pairs) 
RETURN  Coordinate_Pair_Set  is 
BEGIN 

RETURN  (C? . From_Coord inates . Row  => 

(CP . From_Coord ina tes .Column  => 

CP .To_Coordinates)  , 

OTHERS  =>  (OTHERS  =>  (Nullity  =>  Nil))); 
END  Convert_To  Set; 


# 
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FUNCTION  (Set_l ,  Set_2  :  Coor d inate_Pa i r_Se t ) 

RETURN  Coord inate_?ai r_Set  is  --  DIFFERENCE 
I ,  J  :  Index; 

Dummy  :  Coordinate_Pair_Set 

(Set_l 1  RANGE ( 1)  ,  Set_2 ' RANGE ( 2 )  > 

:=  (OTHERS  =>  (Nullity  =>  Nil)); 

BEGIN 

FOR  I  IN  Set_l ' RANGE ( 1)  LOOP 
FOR  J  IN  Set_2 ' RANGE ( 2)  LOOP 

IF  Set_l ( I ,  J)  /=  (Nullity  =>  Nil) 

THEN  IF  Set_2 ( I ,  J)  =  (Nullity  =>  Nil) 

THEN  Dummy (I,  J)  :=  Set_l(I,  J); 

ELSEIF  Set_l ( I ,  J)  /=  Set_2(I,  J) 

THEN  RAISE  Incons i s ten t_Reg i s tr a t ion; 
ENDIF ; 

ENDIF ; 

ENDLOOP ; 

ENDLOOP; 

RETURN  Dummy; 

END 


FUNCTION  Next_Element  (CP  :  Coor d ina te_Pa i r s ; 

Set  :  Coordinate_Pair_Set) 
RETURN  Coord inate_Pa i rs  is 

--  CP  must  be  in  Set  or  the  Null_Reqisterd_Coordintes 
I,  J  :  Index; 

BEGIN 

IF  CP. Nullity  =  Nil 

THEN  I  :=  Set' First (1) ; 

J  :=  Se t ' Fi r s t  (  2 )  ; 

IF  Set{I,  J) .Nullity  /=  Nil 
THEN  RETURN  (Valid, 

From  =  >  ( I ,  J)  , 

To  =>  (Set (I ,  J) ) ; 

ENDIF; 

ELSE  I  :=  CP. From. Row; 

J  :=  CP . From. Column; 

ENDIF; 

WHILE  (I  /=  Set' Last ( 1)  ) 

AND  (J  /=  Set 'Last (2))  LOO? 

IF  J  =  Set' Last  (2) 

THEN  J  :=  Set'First(2) ; 

I  :=  Set' RANGE (1) 'Succ(I) ; 

ELSE  J : =  Set' RANGE ( 2) ' Succ (J) ; 

ENDIF; 

IF  Set(I,  J) .Nullity  /=  Nil 

THEN  RETURN  (Valid,  (I,  J),  Set (I ,  J)); 

ENDIF; 

ENDLOOP; 

RETURN  (Nullity  =>  Nil); 

END  Next  Element; 
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FUNCTION  Registered_Coordinates 

{Cl  :  From_Coordinates ; 

Set  :  Coordinate_Pai r_Set) 
RETURN  To_Coordinates  is 
BEGIN 

RETURN  Set  {Cl. Row,  Cl. Column); 

END  Registered_Coordinates; 

FUNCTION  Change_Regi s te  red_Coord inates 

(CP  :  Valid_Coordinate_Pairs; 
Set  ;  Coordinate_Pair_Set) 
RETURN  Coordinate_Pair_Set  is 
3EGIN 

Set (CP . From_Coordi nates . Row, 

CP . Fr om_Coor d i nates .Column) 

:=  CP . To_Coord inates ; 

Return  Set ; 

END  Change_Registered_Coord inates ; 


PACKAGE  BODY  Register  is 

FUNCTION  Registered_Coordinates 

(From_Point:  From_Coordinates) 
RETURN  To_Coordinates  is 
BEGIN 

RETURN  Map  (From_Point,  Register ed_Map) 
END  Registered_Coordinates; 

FUNCTION  Reg istered_Value 

(From_Point:  From_Coordinates) 
RETURN  Pats  is 
Pt  :  To_Coordinatesl 
BEGIN 

Pt  ;=  Map  (From__Point ,  Registered_Map)  ; 
IF  Pt. Nullity  =  Nil 

THEN  RAISE  No_Reg i stered_Value ; 

ENDIF ; 

RETURN  To_Picture (Pt.Row,  Pt. Column) ; 

END  Registered_Value; 

END  Register; 

END  Coordinate  Pair  Sets; 
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Region  Operations 

FUNCTION  Pat_Value  (R  :  Region;  C  :  Va I  id_Coor d inates ) 
RETURN  Pats  is 
3  EG  IN 

RETURN  R.3ase_Picture  (C.Row,  C. Column); 

END  Pat_Value; 

FUNCTION  Make_Pat_Reg ion  (P  :  Pictures; 

C  :  Val id_Coord inates ) 

RETURN  Region  is 

Dummy  ;  Region  (P'FIRST(l),  P'LAST(l), 

P 1  FIRST ( 2)  ,  P 1  LAST ( 2 )  )  ; 

BEGIN 

Dummy . Base_P ictur e  :=  P; 

Dummy . Reg ion_Members  (C.Row,  C. Column)  :=  True; 
RETURN  Dummy; 

END  Make_Pat_Region ; 

FUNCTION  Make_Region  (P  :  Pictures; 

BP  :  Boolean_Pictures ) 

RETURN  Region  is 

Dummy  :  Region  (P'FIRST(l),  P'LAST(l), 

P ' FIRST ( 2)  ,  P ' LAST ( 2 )  )  ; 

BEGIN 

IF  (P* LENGTH  (1) )  /=  BP’ LENGTH (1) 

OR  (P* LENGTH (2)  /=  BP ' LENGTH ( 2 ) ) 

THEN  RAISE  IncomDa t ible_P ic tur es ; 

END  IF; 

Dummy. Base_Picture  :=  P; 

Dummy , Region_Members  :=  BP; 

RETURN  Dummy; 

END  Make_Region; 

FUNCTION  In_Region  (R  :  Region;  C  :  Valid_Coordinates) 
RETURN  Boolean  is 
BEGIN 

RETURN  R. Region_Members  (C.Row,  C. Column); 

END  In_Region; 

FUNCTION  "+"  (Rl,  R2  :  Region)  RETURN  Region  is  --  Union 
I  :  Index; 

BEGIN 

IF  Rl . Base_P ictur e  /=  R2 .Base_Picture 
THEN  RAISE  IncomDa tible_Reg i ons ; 

ENDIF ; 

FOR  I  IN  RANGE  Rl . Row_F i r s t . . Rl . Row . . Las t  LOOP 
Rl . Reg ion_Member s ( I )  :=  Rl . Region_Membe r s ( I ) 

OR  R2 .Region_Members ( I ) ; 

ENDLOOP; 

RETURN  Rl; 

END  "+"; 


J 
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FUNCTION  (Rl,  R2  :  Region)  RETURN  Region  is 

—  Intersection 
I  :  Index; 

SEGIN 

IF  Rl . Base_P ictur e  /=  R2 .Base_P ictur e 
THEN  RAISE  Incompatible_Regions; 

ENDIF ; 

FOR  I  IN  RANGE  Rl .  Row_F  i  r  s  t .  .  R.l .  Row_Las  t  LOOP 
Rl . Reg ion_Member s  ( I )  :=  Rl .Region_Members ( I ) 

AND  R2 . Region_Members ( I ) ; 

ENDLOOP ; 

RETURN  Rl; 

END  ; 

FUNCTION  (Rl,  R2  :  Region)  RETURN  Region  is 

—  Difference 
I  :  Index; 

BEGIN 

IF  Rl .Base_Picture  /=  R2 .Base_Picture 
THEN  RAISE  Incompa t ible_Reg ions ; 

ENDIF; 

FOR  I  IN  RANGE  Rl . Row_f irst . .Rl ,Row_Last  LOOP 

Rl . Region_Members ( I )  :=  Rl . Reg i on_Membe  r  s ( I )  AND 

(NOT  R2.Reoion_Members (I) ) ; 

ENDLOOP; 

RETURN  Rl; 

END 

FUNCTION  Complement  (R  :  Region)  RETURN  Region; 

Dummy  .  Region  (R.Row_First,  R.Row_Last, 

R.Column_First,  R.Column_Last) ; 

I  ;  Index; 

BEGIN 

Dummy . Base_P ictur e  :=  R.Base_Picture; 

FOR  I  IN  R . Row_F i r s t . . R . Row_Las t  LOOP 
Dummy . Reg ion_Member s ( I )  :=  NOT  R. Reg ion_Member s ( I ) ; 

END  LOOP; 

RETURN  Dummy; 

END  Complement; 

FUNCTION  Picture_Of  (R  :  Region)  RETURN  Pictures  is 
BEGIN 

RETURN  R. Base_P ictur e ; 

END  Picture  Of; 
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FUNCTION  Next_Member  (C  :  Coordinates;  R  :  Region) 
RETURN  Coordinates  is 
—  C  must  be  in  R  or  the  Null  Coordinates 
I,  J  :  Index; 

BEGIN 

IF  C. Nullity  =  Nil 

THEN  I  :=  R.Row_First; 

J  :=  R.Column_Fi rst; 

IF  In-Region  (R,  (I,  J) ) 

THEN  RETURN  (Valid,  Row  =>  I, 

Column  =>  J) ; 

ENDIF; 

ELSE  I  ;=  C . Row; 

J  :=  C. Column; 

ENDIF; 

WHILE  (I  /=  R. Row_Last) 

AND  (J  /=  R.Column_Last)  LOOP 
IF  J  =  R . Column_Las t 

THEN  J  :=  R.Column_First; 

I  : =  Index ' Succ  ( I ) ; 

ELSE  J:=  Index ' Succ (J) ; 

ENDIF; 

IF  In_Region  (R,  (I,  J) ) 

THEN  RETURN  (Valid,  I,  J); 

ENDIF; 

ENDLOOP; 

RETURN  (Nullity  =>  Mil); 

END  Next_Member; 

FUNCTION  Region_Binary_Op  (Left  :  Region; 

Right  :  Picture_2) 

RETURN  Region; 

—  Left  and  Right  must  be  of  the  same  size 

--  i.e.  Left. Last  -  Left. First  =  Right' LENGTH 

—  Incompatible_Regions  is  raised  if  they  are  not 

I ,  J  :  Index ; 

Dummy  :  Region  ( R . Row_F i r s t ,  R.Row_Last, 

R . Co lumn_F i r s t ,  R.Column_Last)  ; 

BEGIN 

IF  NOT  ( ( R . Row_Las t-R . Row_F i r st  =  Right ' Range ( 1 ) ) 
OR  (R.Column_Last  -  R.Column_First 

=  Right’ RANGE ( 2) ) ) 
THEN  RAISE  Incompa tible_Regions ; 

ENDIF; 

Dummv.Base_Picture  :=  Lef t.Base_Picture; 

FOR  I  in  Right' RANGE (1)  LOOP 
FOR  J  in  Right’ RANGE (2)  LOOP 
Dummy . Reg ion_Membe r s  (I,  J) 

:=  F (Lef t . Reg ion_Member s ( I , J ) ,  Right(I,J)); 
END  LOOP; 

END  LOOP 
RETURN  Dummy; 

END  Picture_Binarv_Op; 
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FUNCTION  Not_In_Border (I ,  J  :  Index)  RETURN  Boolean  is 
3EGIN 

RETURN  False; 

END  Not_In_Border ; 

FUNCTION  Region_Flv  (R  :  Region; 

Ml  :  Mask_l; 

Mask-Center  :  Valid_Coordinates) 

RETURN  Region; 

Dummy  :  Region  (R.Row_First,  R.Row_Last, 

R.Column_First,  R.Column_Last) ; 

M2  ;  Boolean_Mask  (Ml ' RANGE ( 1)  ,  Ml 1  RANGE ( 2) ) ; 

I,  J,  I_Of£set,  J_Offset,  K,  N  :  Index; 
Hex_Correction  :  Index  RANGE  1..0; 

BEGIN 

FOR  I  IN  R . Row_F i r s  t . . R . Row_La s  t  LOOP 

FOR  J  IN  R.Column_First. . R.Column_Last  LOOP 
IF  (Organization  /=  Orthogonal) 

AMD  THEN  ((Rem  (Mask_Center . Row ,  2)) 

=  (Rem  (I,  2))) 

THEN  Hex_Cor r ect ion  :=  0; 

ELSE  Hex_Cor rection  :=  1; 

ENDIF ; 

FOR  K  IN  M2' RANGE (1)  LOOP 
FOR  N  IN  M2' RANGE (2)  LOOP 

I_Offset  I  +  Mask_Centec . Row  -  K; 
J_Offset  :=  J  +  Mask_Center .Column 
-  N  +  Hex_Correction; 

IF  (l_0£f set  IN  R . Row_F i r s t . . R . Ro w_La s t ) 
AND  (J_Offset  IN 

R.Column_First. .R.Column_Last) 
THEN  M2 ( K , N )  ;= 

R . Region_Memeber s ( I_Of  fset , J_0£ f set ) ; 
ELSE  M2 (K,N)  ;= 

3order_Value ( I_Of f set t  J_Offset) ; 

ENDIF; 

END  LOOP; 

END  LOOP; 

Dummy .Region_Members (I , J)  :=  F(M1,  M2^ ; 

END  LOOP ; 

END  LOOP; 

Dummy .Base_Picture  ;=  R.Base_Picture; 

RETURN  Dummy; 

END  Region_Fly; 


Boundary  Operations 


FUNCTION  Make_Boundar y  (R  :  Region;  A  :  Adjacency) 
RETURN  Boundary  is 

Dummy  :  Boundary  (R.Row_First,  R.Row_Last, 

R.Column_First,  R.Column_Last) ; 
C  ;  Coordinates  :=  (Nullity  =>  Nil); 

I,  J,  K,  N  :  Index; 

Done  :  Boolean; 

BEGIN 

Dummy . Base_Reg ion  :=  R; 

Dummy. Boundary_Ad j acency  :=  A; 

C  :=  Next_Member  (C,  R) ; 

WHILE  C.Nulllity  /=  Nil  LOOP 
Done  :=  False; 

K  :=  0; 

N  :=  -1; 

WHILE  NOT  Done  LOOP 
CASE  K  is 


WHEN  -1  =>  N  :=  N  +  1; 

WHEN  0  =>  K  :=  K  +  N; 

WHEN  +1  =  >  N  : =  N  -  1 ; 

WHEN  OTHERS  =>  NULL; 
END  CASE; 

IF  Abs  (N)  =  2 
THEN  N  ;=  N/2; 

K  :=  0; 

ENDIF ; 


I  : =  C . Row  +  K ; 

J  :=  C. Column  +  N; 

IF  (I  IN  RANGE  R. Row_F i r s t . . R . Row_Las t) 

AND ( J  IN  RANGE  R.Column_F i r s t . . R . Column_Las t ) 
AND  THEN  (Adjacent  (C,  (I,  J)  ,  A)) 

AND  THEN  (NOT  R. Reg ion_Membe r s  (I,  J) ) 

THEN  Dummy .Boundary_Members  (I,  J)  ;=  On; 

Done  ;=  True; 

ELSEIF  (K  =  0)  AND  (N  =  -1) 

THEN  Done  ;=  True; 

IF  (Dummy . Boundary_Members 

(C . Row ,  C. Column)  =  Off) 
AND  THEN  ((C.Row  =  R.Row_First)  OR  ELSE 
(D.Row  =  R,Row_Last)  OR  ELSE 
(C. Column  =  R.Column_First) 

OR  ELSE  (C .Column=R.Column_Last) ) 
THEN  Dummy .Boundary_Members 

(C.Row,  C. Column)  :=  Limit; 

ENDIF; 

ENDIF; 

END  LOOP; 


C  :=  NEXT_Membe r  (C,  R) ; 
END  LOOP; 

END  Make_Boundar y ; 


] 
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FUNCTION  Pat_Value  (B  :  Boundary;  C  :  Val id_Coordinates) 
RETURN  Pats  is 
BEGIN 

RETURN  B.Base_Region.Base_Picture  (C.Row,  C. Column); 
END  Pat_Value ; 

FUNCTION  In_Region  (  B  :  Boundary;  C  :  Valid_Coordinates) 
RETURN  Boolean  is 
BEGIN 

RETURN  B . Base_Reg ion . Region_Member s (C . Row ,C .Column) ; 
END  In_Region; 

FUNCTION  On_Boundary  (B  ;  Boundary; 

C  :  Val id_Coordinates) 

RETURN  3oundary_Classif ication  is 
BEGIN 

RETURN  B . Boundary_Member s  (C.Row,  C. Column); 

END  On_Boundary; 

FUNCTION  Region_Of  (B  :  Boundary)  RETURN  Region; 

BEGIN 

RETURN  B.Base_Region; 

END  Region_Of; 


/ 
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FUNCTION  Next_Pat  (B  :  Boundary; 

A  :  Adjacency; 

D  :  Direction; 

C_On,  C_previous  :  Coordinates) 

RETURN  Coordinates  is 
I,  J,  K,  N  :  Index; 

Found  :  Boolean; 

BEGIN 

IF  (B.Boundary_Members (C_On.Row,  C_On. Column)  =  Off) 
OR  {B . Boundary_members 

(C_Previous .Row,  C_Previous .Column)  =  Off) 
OR  NOT  (Adjacent  (C_On,  C_Previous,  A)) 

THEN  RAISE  Incompatible_Coordinates; 

ENDIF ; 

K  :=  C_On.Row  -  C_Pr evious . Row; 

N  :=  C_On. Column  -  C . Previous .Column; 

Found  ;=  False; 

WHILE  NOT  Found  LOO? 

CASE  K  is 

WHEN  -1  =>  IF  D  =  Clockwise 

THEN  N  :=  N  +  1; 

ELSE  N  :=  N  -  1;  — Counterclockwise 
ENDIF; 

WHEN  0  =>  IF  D  =  Clockwise 

THEK  K  :=  K  +  N; 

ELSE  K  :=  K  -  N;  --Counterclockwise 
ENDIF; 

WHEN  +1  =>  IF  D  =  Clockwise 

THEN  N  :=  N  -  1; 

ELSE  N  ;=  N  +  1;  — Counterclockwise 
ENDIF; 

WHEN  OTHERS  =>  RAISE  I ncompat ible_Coor d ina tes ; 
END  CASE ; 

IF  Abs  (N)  =  2 

THEN  N  ;=  N/2;  K  :=  0; 

ENDIF; 

I  :=  C_On.Row  +  N;  J  :=  C_Column  +  K; 

—  Have  the  next  8-neighbor  to  try 

IF  (I  IN  RANGE  R. Row_F i r s t . . R>Row_Las t ) 

AND  (J  IN  RANGE  R . Column_F i r s t . . R . Column_Las t ) 
AND  THEN  { B . Bounda r y_Membe r s  (I,  J)  /=  Off) 

AND  THEN  (Adjacent  (  (I,  J),  C_On,  A)) 

THEN  Found  :=  True; 

ELSEIF  (I  =  C_On.Row  -  C_Pr evious . Row) 

AND  (J  =  C_On. Column  -  C_Previous .Column) 
THEN  EXIT  LOOP; 

ENDIF; 

END  LOOP; 

IF  Found 

THEN  RETURN  (I,  J); 

ELSE  RETURN  C  On; 

ENDIF; 

END  Next  Pat; 
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